2023-07-29T16:47:10.965 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T16:47:10.966 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901 --owner scheduled_yuriw@teuthology --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} --name yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/orig.config.yaml 2023-07-29T16:47:10.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:47:11.086 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901 branch: reef-release description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} email: null first_in_suite: false job_id: '7356901' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef-release ceph: conf: client: client_oc_max_dirty_age: 1 ms_inject_delay_max: 5 ms_inject_delay_probability: 1 ms_inject_delay_type: osd mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 3661 sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2Bjd/ZGQhyoEuwFQwQQmUSQXzEQbGCtKDDAXPgpBQRl45pawflo3FDuk7rbBP/28IWBpFaNlJ1iap8WJwjKs= smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiwLGs5m8L0bpDn2lsgJZ/+ay7fE4GJIZ++UhZ7gxzJIntha1mlOWWz42UmN7gSs6905UtUSKrI7DD4zYicen9SH7+5WBmnUXN7A/3/D0OQmzDxCJFt7JcvuRPOTvN3YunJi/sXTbhoEEgCfZWQZYzs81ZgNk1CaVfexDjLosEVQd6yiJ6AKdf9j+VIXwA5nGqmcAN2HXdyYVSwx2lZ9gkXMtYehbe87PotzRxwzIS1HjTz8UmYQ/PW9mFDS2NT9vWyGQPf8swTTfgQQOcR6I1dzwgZpkkEKSdQkeL4IFYOYliBkmnj5fF8AfKVYRRi1UO6ALeaH+nnik8aGKpvrtipkMrfIc+t2PzJyBf8d/0xaq4x1YUygGVhyfwrGPTqBuGqvlemDgds+Ix1T/1VzRiLqJ7lrw4zCR61KxHMw+43k/8U53arklMX0wtzDpw6T1tEdj/bPBW6p+HkV4TH4GOVOEI1YR9HGzWab+XWM4kdYU63IYePObQGcXY8V9B1pE= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIOkKTrnE+MDnQ3zMC3F8KzYp2EEcmantLIhl3bCESBJZ7W/f3DcEJRftdgI1kyN5vk9JkDtyGoxTOuKcoZITg= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORe7mcvQFGKGkEap257O5iQXeqpDvrZiIA9ntANn9yDV9mABFmG8Hamo73KBs9/3eSlYNsq4hye9Bs73yVtEsM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - exec: client.0: - dd if=/dev/zero of=./foo count=100 - sleep 2 - truncate --size 0 ./foo teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 61140164d2579c30ffff3970615e0f82e40c6470 timestamp: 2023-07-29_14:04:17 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-29T16:47:11.086 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa; will attempt to use it 2023-07-29T16:47:11.087 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks 2023-07-29T16:47:11.087 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-29T16:47:11.089 INFO:teuthology.task.internal:Checking packages... 2023-07-29T16:47:11.118 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0484097b0572e96f42cf6402cbe0ac8dcb046577' 2023-07-29T16:47:11.119 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-29T16:47:11.119 INFO:teuthology.packaging:ref: None 2023-07-29T16:47:11.119 INFO:teuthology.packaging:tag: None 2023-07-29T16:47:11.120 INFO:teuthology.packaging:branch: reef-release 2023-07-29T16:47:11.120 INFO:teuthology.packaging:sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:47:11.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef-release 2023-07-29T16:47:11.351 INFO:teuthology.task.internal:Found packages for ceph version 18.1.3-11.g0484097b 2023-07-29T16:47:11.351 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-29T16:47:11.360 INFO:teuthology.task.internal:no buildpackages task found 2023-07-29T16:47:11.360 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-29T16:47:11.408 INFO:teuthology.task.internal:Saving configuration 2023-07-29T16:47:11.420 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-29T16:47:11.435 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:47:11.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.074689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2Bjd/ZGQhyoEuwFQwQQmUSQXzEQbGCtKDDAXPgpBQRl45pawflo3FDuk7rbBP/28IWBpFaNlJ1iap8WJwjKs='} 2023-07-29T16:47:11.486 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.071864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYXOQrWa387iZheV494QwpNiZ71iPam33rBIYWhPS8F1vzhGY2qKSRiZtYgxCmjljtUAyBpT/9pblk65KodbSQ='} 2023-07-29T16:47:11.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.070253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIOkKTrnE+MDnQ3zMC3F8KzYp2EEcmantLIhl3bCESBJZ7W/f3DcEJRftdgI1kyN5vk9JkDtyGoxTOuKcoZITg='} 2023-07-29T16:47:11.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.073316', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORe7mcvQFGKGkEap257O5iQXeqpDvrZiIA9ntANn9yDV9mABFmG8Hamo73KBs9/3eSlYNsq4hye9Bs73yVtEsM='} 2023-07-29T16:47:11.538 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-29T16:47:11.549 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-07-29T16:47:11.549 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['osd.0'] 2023-07-29T16:47:11.549 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['osd.1'] 2023-07-29T16:47:11.550 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['osd.2'] 2023-07-29T16:47:11.550 INFO:teuthology.run_tasks:Running task console_log... 2023-07-29T16:47:11.721 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c336e7ee0>, signals=[15]) 2023-07-29T16:47:11.723 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-29T16:47:11.731 INFO:teuthology.task.internal:Opening connections... 2023-07-29T16:47:11.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T16:47:11.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:47:11.801 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-07-29T16:47:11.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:47:11.870 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T16:47:11.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:47:11.935 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-07-29T16:47:11.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:47:12.002 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-29T16:47:12.014 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-07-29T16:47:12.037 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-07-29T16:47:12.037 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-07-29T16:47:12.097 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-07-29T16:47:12.097 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-07-29T16:47:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T16:47:12.099 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-07-29T16:47:12.099 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:47:12.099 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:47:12.099 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T16:47:12.100 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-07-29T16:47:12.122 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-07-29T16:47:12.144 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-07-29T16:47:12.144 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-29T16:47:12.206 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-07-29T16:47:12.206 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8" 2023-07-29T16:47:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-07-29T16:47:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-07-29T16:47:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2023-07-29T16:47:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:47:12.207 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T16:47:12.208 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-29T16:47:12.208 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T16:47:12.208 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-07-29T16:47:12.209 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:47:12.209 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:47:12.209 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T16:47:12.210 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-29T16:47:12.231 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-29T16:47:12.254 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-29T16:47:12.254 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-29T16:47:12.315 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-29T16:47:12.315 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-29T16:47:12.316 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T16:47:12.317 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-29T16:47:12.317 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:47:12.317 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:47:12.317 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T16:47:12.317 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-29T16:47:12.339 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-07-29T16:47:12.360 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-07-29T16:47:12.361 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-07-29T16:47:12.422 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-07-29T16:47:12.422 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-07-29T16:47:12.422 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-07-29T16:47:12.423 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-07-29T16:47:12.423 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-07-29T16:47:12.423 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:47:12.424 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T16:47:12.424 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-07-29T16:47:12.424 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T16:47:12.425 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-07-29T16:47:12.425 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:47:12.425 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:47:12.425 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T16:47:12.426 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-07-29T16:47:12.447 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-29T16:47:12.463 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-29T16:47:12.487 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-29T16:47:12.488 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:47:12.490 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:47:12.493 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:47:12.495 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:47:12.515 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-29T16:47:12.526 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-29T16:47:12.526 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:47:12.551 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:47:12.553 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:47:12.555 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:47:12.591 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-29T16:47:12.718 INFO:teuthology.run_tasks:Running task kernel... 2023-07-29T16:47:12.735 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-29T16:47:12.736 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-29T16:47:12.736 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:47:12.737 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:47:12.737 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:47:12.738 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:47:12.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:12.758 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-07-29T16:47:12.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:12.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:12.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:12.761 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-07-29T16:47:12.761 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-07-29T16:47:12.762 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-07-29T16:47:12.819 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-489.el8.x86_64 2023-07-29T16:47:12.819 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.18.0-489.el8.x86_64 2023-07-29T16:47:12.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2023-07-29T16:47:12.822 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-489.el8.x86_64 2023-07-29T16:47:12.822 INFO:teuthology.task.kernel:Running kernel on smithi153: 4.18.0-489.el8.x86_64 2023-07-29T16:47:12.822 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2023-07-29T16:47:12.824 INFO:teuthology.orchestra.run.smithi093.stdout:4.18.0-489.el8.x86_64 2023-07-29T16:47:12.825 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-489.el8.x86_64 2023-07-29T16:47:12.825 INFO:teuthology.task.kernel:Running kernel on smithi093: 4.18.0-489.el8.x86_64 2023-07-29T16:47:12.825 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum install -y kernel 2023-07-29T16:47:12.826 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-489.el8.x86_64 2023-07-29T16:47:12.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-07-29T16:47:20.364 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - AppStream 6.0 MB/s | 31 MB 00:05 2023-07-29T16:47:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 5.5 MB/s | 31 MB 00:05 2023-07-29T16:47:21.027 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - AppStream 5.4 MB/s | 31 MB 00:05 2023-07-29T16:47:21.356 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - AppStream 5.2 MB/s | 31 MB 00:05 2023-07-29T16:47:27.630 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 41 MB 00:01 2023-07-29T16:47:28.543 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 41 MB 00:01 2023-07-29T16:47:30.073 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 41 MB 00:03 2023-07-29T16:47:30.178 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 41 MB 00:03 2023-07-29T16:47:33.929 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2023-07-29T16:47:34.330 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.6 kB 00:00 2023-07-29T16:47:34.614 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-07-29T16:47:34.835 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2023-07-29T16:47:35.227 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 6.6 kB 00:00 2023-07-29T16:47:35.512 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-07-29T16:47:36.341 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras 81 kB/s | 18 kB 00:00 2023-07-29T16:47:36.495 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2023-07-29T16:47:36.867 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.6 kB 00:00 2023-07-29T16:47:37.037 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.6 kB 00:00 2023-07-29T16:47:37.152 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-07-29T16:47:37.330 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-07-29T16:47:37.831 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2023-07-29T16:47:38.753 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-07-29T16:47:41.606 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 247 kB/s | 24 kB 00:00 2023-07-29T16:47:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 632 kB/s | 24 kB 00:00 2023-07-29T16:47:44.846 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-29T16:47:44.847 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-29T16:47:45.073 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-07-29T16:47:45.074 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-07-29T16:47:45.074 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-07-29T16:47:45.074 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:47:45.075 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-07-29T16:47:45.076 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-07-29T16:47:45.076 INFO:teuthology.orchestra.run.smithi093.stdout:Install 3 Packages 2023-07-29T16:47:45.076 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:47:45.077 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 88 M 2023-07-29T16:47:45.077 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 95 M 2023-07-29T16:47:45.078 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-07-29T16:47:45.618 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-29T16:47:45.618 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-29T16:47:45.840 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-07-29T16:47:45.841 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-07-29T16:47:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-29T16:47:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:47:45.843 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-07-29T16:47:45.843 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-07-29T16:47:45.843 INFO:teuthology.orchestra.run.smithi073.stdout:Install 3 Packages 2023-07-29T16:47:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:47:45.844 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 88 M 2023-07-29T16:47:45.844 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 95 M 2023-07-29T16:47:45.844 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-07-29T16:47:46.291 INFO:teuthology.orchestra.run.smithi093.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 8.4 MB/s | 9.8 MB 00:01 2023-07-29T16:47:46.996 INFO:teuthology.orchestra.run.smithi073.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 9.0 MB/s | 9.8 MB 00:01 2023-07-29T16:47:47.824 INFO:teuthology.orchestra.run.smithi093.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 13 MB/s | 35 MB 00:02 2023-07-29T16:47:48.449 INFO:teuthology.orchestra.run.smithi093.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-07-29T16:47:48.450 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:47:48.450 INFO:teuthology.orchestra.run.smithi093.stdout:Total 26 MB/s | 88 MB 00:03 2023-07-29T16:47:48.946 INFO:teuthology.orchestra.run.smithi073.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 12 MB/s | 35 MB 00:03 2023-07-29T16:47:49.114 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-07-29T16:47:49.479 INFO:teuthology.orchestra.run.smithi073.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 12 MB/s | 43 MB 00:03 2023-07-29T16:47:49.480 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:47:49.480 INFO:teuthology.orchestra.run.smithi073.stdout:Total 24 MB/s | 88 MB 00:03 2023-07-29T16:47:49.540 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-07-29T16:47:49.540 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-07-29T16:47:50.143 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-07-29T16:47:50.563 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-07-29T16:47:50.563 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-07-29T16:47:50.748 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-07-29T16:47:50.761 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-07-29T16:47:51.805 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-07-29T16:47:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-07-29T16:47:53.500 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-07-29T16:47:53.935 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:47:54.356 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 947 kB/s | 16 MB 00:16 2023-07-29T16:47:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-07-29T16:47:55.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:47:57.552 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:47:57.926 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:47:58.287 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 91 kB/s | 24 kB 00:00 2023-07-29T16:47:58.684 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:47:59.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:01.281 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-29T16:48:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-29T16:48:01.570 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:01.675 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-07-29T16:48:01.676 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-07-29T16:48:01.676 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-07-29T16:48:01.676 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-07-29T16:48:01.676 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-07-29T16:48:01.676 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-07-29T16:48:01.677 INFO:teuthology.orchestra.run.smithi153.stdout:Install 3 Packages 2023-07-29T16:48:01.678 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:01.678 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 88 M 2023-07-29T16:48:01.678 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 95 M 2023-07-29T16:48:01.678 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-07-29T16:48:02.442 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:02.763 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:04.963 INFO:teuthology.orchestra.run.smithi153.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 3.0 MB/s | 9.8 MB 00:03 2023-07-29T16:48:09.896 INFO:teuthology.orchestra.run.smithi153.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 4.3 MB/s | 35 MB 00:08 2023-07-29T16:48:11.679 INFO:teuthology.orchestra.run.smithi153.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 4.3 MB/s | 43 MB 00:09 2023-07-29T16:48:11.680 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:48:11.680 INFO:teuthology.orchestra.run.smithi153.stdout:Total 8.8 MB/s | 88 MB 00:10 2023-07-29T16:48:12.345 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-07-29T16:48:12.772 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-07-29T16:48:12.772 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-07-29T16:48:13.972 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-07-29T16:48:13.996 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-07-29T16:48:16.731 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-07-29T16:48:17.196 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:48:20.752 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:48:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:23.273 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:23.297 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:23.671 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:23.671 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:48:23.671 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:24.345 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:48:24.346 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-07-29T16:48:24.415 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:24.438 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:24.490 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:24.706 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:24.706 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:24.707 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-29T16:48:24.707 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-29T16:48:24.707 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-29T16:48:24.707 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2023-07-29T16:48:24.707 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi093.front.sepia.ceph.com, path=None, version=distro) 2023-07-29T16:48:24.707 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:24.775 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:24.776 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:48:24.776 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:24.866 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:24.912 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:24.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:24.914 DEBUG:teuthology.orchestra.run.smithi093:> sudo rpm -qi grub2-tools 2023-07-29T16:48:24.947 INFO:teuthology.orchestra.run.smithi093.stdout:Name : grub2-tools 2023-07-29T16:48:24.947 INFO:teuthology.orchestra.run.smithi093.stdout:Epoch : 1 2023-07-29T16:48:24.947 INFO:teuthology.orchestra.run.smithi093.stdout:Version : 2.02 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:Release : 129.el8 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:Architecture: x86_64 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:Group : System Environment/Base 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:Size : 9265586 2023-07-29T16:48:24.948 INFO:teuthology.orchestra.run.smithi093.stdout:License : GPLv3+ 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Relocations : (not relocatable) 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Packager : CentOS BuildSystem 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:Vendor : CentOS 2023-07-29T16:48:24.949 INFO:teuthology.orchestra.run.smithi093.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:Summary : Support tools for GRUB. 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:Description : 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-29T16:48:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-29T16:48:24.951 INFO:teuthology.orchestra.run.smithi093.stdout:hardware devices. 2023-07-29T16:48:24.951 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T16:48:24.951 INFO:teuthology.orchestra.run.smithi093.stdout:This subpackage provides tools for support of all platforms. 2023-07-29T16:48:24.952 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-29T16:48:24.952 INFO:teuthology.task.kernel:Updating grub on smithi093 to boot 4.18.0-500.el8.x86_64 2023-07-29T16:48:24.952 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-29T16:48:25.475 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:48:25.476 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-07-29T16:48:25.608 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:25.899 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:25.900 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:25.900 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-29T16:48:25.900 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-29T16:48:25.901 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-29T16:48:25.901 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-07-29T16:48:25.901 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2023-07-29T16:48:25.902 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:26.106 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:26.107 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:26.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2023-07-29T16:48:26.140 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2023-07-29T16:48:26.140 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.02 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 129.el8 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Group : System Environment/Base 2023-07-29T16:48:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 9265586 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Relocations : (not relocatable) 2023-07-29T16:48:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : CentOS BuildSystem 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-29T16:48:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-29T16:48:26.144 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-29T16:48:26.144 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2023-07-29T16:48:26.144 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T16:48:26.144 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2023-07-29T16:48:26.145 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-29T16:48:26.145 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 4.18.0-500.el8.x86_64 2023-07-29T16:48:26.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-29T16:48:26.716 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-07-29T16:48:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-07-29T16:48:28.552 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-07-29T16:48:28.555 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-07-29T16:48:28.593 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.co1hH1jErs 2023-07-29T16:48:28.593 DEBUG:teuthology.orchestra.run.smithi093:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.co1hH1jErs 2023-07-29T16:48:28.666 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.co1hH1jErs 2023-07-29T16:48:28.805 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.co1hH1jErs is 6KB 2023-07-29T16:48:28.826 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.co1hH1jErs 2023-07-29T16:48:28.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo /bin/ls /boot/loader/entries || true 2023-07-29T16:48:28.909 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-29T16:48:28.909 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-29T16:48:28.909 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-29T16:48:28.909 INFO:teuthology.orchestra.run.smithi093.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-29T16:48:28.910 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-29T16:48:29.098 DEBUG:teuthology.orchestra.run.smithi093:> sudo shutdown -r now 2023-07-29T16:48:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-07-29T16:48:30.232 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-07-29T16:48:30.299 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.SEohr3tizw 2023-07-29T16:48:30.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SEohr3tizw 2023-07-29T16:48:30.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.SEohr3tizw 2023-07-29T16:48:30.496 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.SEohr3tizw is 6KB 2023-07-29T16:48:30.544 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.SEohr3tizw 2023-07-29T16:48:30.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2023-07-29T16:48:30.633 INFO:teuthology.orchestra.run.smithi073.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-29T16:48:30.634 INFO:teuthology.orchestra.run.smithi073.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-29T16:48:30.634 INFO:teuthology.orchestra.run.smithi073.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-29T16:48:30.634 INFO:teuthology.orchestra.run.smithi073.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-29T16:48:30.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-29T16:48:30.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2023-07-29T16:48:46.723 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:47.088 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:47.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:48:47.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:48:48.152 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:48:48.152 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:48.153 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-07-29T16:48:48.153 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-29T16:48:48.153 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-29T16:48:48.153 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:48.153 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-07-29T16:48:48.287 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:48.523 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:48.524 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:48.524 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-29T16:48:48.524 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-29T16:48:48.524 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-29T16:48:48.525 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2023-07-29T16:48:48.525 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2023-07-29T16:48:48.525 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:48:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:48:48.733 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:48:48.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2023-07-29T16:48:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2023-07-29T16:48:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2023-07-29T16:48:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.02 2023-07-29T16:48:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 129.el8 2023-07-29T16:48:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Group : System Environment/Base 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 9265586 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-29T16:48:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Relocations : (not relocatable) 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : CentOS BuildSystem 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2023-07-29T16:48:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T16:48:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2023-07-29T16:48:48.810 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-29T16:48:48.810 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 4.18.0-500.el8.x86_64 2023-07-29T16:48:48.811 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-29T16:48:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-07-29T16:48:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-07-29T16:48:51.950 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-07-29T16:48:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.rG54qFitie 2023-07-29T16:48:52.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rG54qFitie 2023-07-29T16:48:52.037 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.rG54qFitie 2023-07-29T16:48:52.175 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.rG54qFitie is 6KB 2023-07-29T16:48:52.197 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.rG54qFitie 2023-07-29T16:48:52.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2023-07-29T16:48:52.280 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-29T16:48:52.280 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-29T16:48:52.280 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-29T16:48:52.281 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-29T16:48:52.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-29T16:48:52.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2023-07-29T16:48:59.101 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2023-07-29T16:48:59.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T16:48:59.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:00.793 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-29T16:49:00.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T16:49:00.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:17.425 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T16:49:19.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-07-29T16:49:22.439 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2023-07-29T16:49:22.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T16:49:22.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:26.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T16:49:26.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:28.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T16:49:28.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:29.488 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T16:49:31.280 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-07-29T16:49:40.976 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-29T16:49:41.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T16:49:41.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:43.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T16:49:43.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:49.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T16:49:49.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:49:53.040 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-29T16:49:59.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T16:50:01.712 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-07-29T16:50:05.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T16:50:05.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:50:14.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T16:50:14.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:50:15.821 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-29T16:50:16.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T16:50:16.637 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-500.el8.x86_64"... 2023-07-29T16:50:16.638 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-07-29T16:50:16.695 INFO:teuthology.orchestra.run.smithi093.stdout:4.18.0-500.el8.x86_64 2023-07-29T16:50:16.696 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-29T16:50:16.696 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-29T16:50:16.696 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-29T16:50:16.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T16:50:16.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:50:17.282 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-29T16:50:17.697 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-07-29T16:50:17.698 DEBUG:teuthology.orchestra.run.smithi093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:50:17.767 INFO:teuthology.orchestra.run.smithi093.stdout:ttyS1 2023-07-29T16:50:17.782 DEBUG:teuthology.parallel:result is None 2023-07-29T16:50:18.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T16:50:18.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-500.el8.x86_64"... 2023-07-29T16:50:18.701 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-07-29T16:50:18.724 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-500.el8.x86_64 2023-07-29T16:50:18.724 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-29T16:50:18.725 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-29T16:50:18.725 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-29T16:50:19.726 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-29T16:50:19.726 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:50:19.793 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2023-07-29T16:50:19.806 DEBUG:teuthology.parallel:result is None 2023-07-29T16:50:23.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-29T16:50:38.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T16:50:38.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:50:38.765 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-29T16:50:39.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T16:50:39.025 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-500.el8.x86_64"... 2023-07-29T16:50:39.025 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-07-29T16:50:39.042 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-500.el8.x86_64 2023-07-29T16:50:39.042 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-29T16:50:39.043 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-29T16:50:39.043 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-29T16:50:40.043 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-07-29T16:50:40.044 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:50:40.147 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2023-07-29T16:50:40.173 DEBUG:teuthology.parallel:result is None 2023-07-29T16:54:08.968 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 41 kB/s | 16 MB 06:34 2023-07-29T16:54:12.683 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-07-29T16:54:15.848 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-29T16:54:15.848 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-29T16:54:16.067 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-07-29T16:54:16.068 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-07-29T16:54:16.068 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-29T16:54:16.069 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-29T16:54:16.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:16.070 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-07-29T16:54:16.070 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-07-29T16:54:16.070 INFO:teuthology.orchestra.run.smithi092.stdout:Install 3 Packages 2023-07-29T16:54:16.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:16.071 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 88 M 2023-07-29T16:54:16.071 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 95 M 2023-07-29T16:54:16.071 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-07-29T16:54:16.776 INFO:teuthology.orchestra.run.smithi092.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 15 MB/s | 9.8 MB 00:00 2023-07-29T16:54:17.576 INFO:teuthology.orchestra.run.smithi092.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 24 MB/s | 35 MB 00:01 2023-07-29T16:54:18.118 INFO:teuthology.orchestra.run.smithi092.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 22 MB/s | 43 MB 00:01 2023-07-29T16:54:18.118 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:54:18.119 INFO:teuthology.orchestra.run.smithi092.stdout:Total 43 MB/s | 88 MB 00:02 2023-07-29T16:54:18.777 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-07-29T16:54:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-07-29T16:54:19.212 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-07-29T16:54:20.424 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-07-29T16:54:20.456 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-07-29T16:54:23.203 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-07-29T16:54:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:54:27.258 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:54:27.664 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:54:31.025 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:54:31.342 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:54:53.255 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:54:53.277 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:54:53.682 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:54:53.682 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-29T16:54:53.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-29T16:54:54.286 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-29T16:54:54.286 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:54.286 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-07-29T16:54:54.287 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-29T16:54:54.287 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-29T16:54:54.287 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:54.287 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-07-29T16:54:54.430 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:54:54.647 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:54:54.648 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:54:54.648 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-29T16:54:54.648 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-29T16:54:54.649 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-29T16:54:54.649 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2023-07-29T16:54:54.649 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2023-07-29T16:54:54.649 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:54:54.854 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-29T16:54:54.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-29T16:54:54.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2023-07-29T16:54:54.888 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2023-07-29T16:54:54.888 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2023-07-29T16:54:54.888 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.02 2023-07-29T16:54:54.888 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 129.el8 2023-07-29T16:54:54.888 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:Group : System Environment/Base 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 9265586 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-29T16:54:54.889 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Relocations : (not relocatable) 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : CentOS BuildSystem 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-29T16:54:54.890 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2023-07-29T16:54:54.891 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T16:54:54.892 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2023-07-29T16:54:54.893 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-29T16:54:54.893 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 4.18.0-500.el8.x86_64 2023-07-29T16:54:54.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-29T16:54:56.325 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2023-07-29T16:54:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:done 2023-07-29T16:54:58.394 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-07-29T16:54:58.442 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.9yRMwm1kj5 2023-07-29T16:54:58.443 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9yRMwm1kj5 2023-07-29T16:54:58.480 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.9yRMwm1kj5 2023-07-29T16:54:58.624 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.9yRMwm1kj5 is 6KB 2023-07-29T16:54:58.671 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.9yRMwm1kj5 2023-07-29T16:54:58.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2023-07-29T16:54:58.763 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-29T16:54:58.763 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-29T16:54:58.763 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-29T16:54:58.764 INFO:teuthology.orchestra.run.smithi092.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-29T16:54:58.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-29T16:54:58.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2023-07-29T16:55:28.944 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2023-07-29T16:55:28.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T16:55:28.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:55:47.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-29T16:55:56.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T16:55:56.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:55:59.380 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-29T16:56:11.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T16:56:11.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:56:43.247 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-29T16:56:43.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T16:56:43.604 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-500.el8.x86_64"... 2023-07-29T16:56:43.604 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-07-29T16:56:43.622 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-500.el8.x86_64 2023-07-29T16:56:43.623 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-29T16:56:43.623 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-29T16:56:43.623 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-29T16:56:44.625 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-07-29T16:56:44.625 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:56:44.701 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2023-07-29T16:56:44.719 DEBUG:teuthology.parallel:result is None 2023-07-29T16:56:44.720 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-29T16:56:44.728 INFO:teuthology.task.internal:Creating test directory... 2023-07-29T16:56:44.728 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:56:44.731 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:56:44.734 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:56:44.737 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:56:44.761 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-29T16:56:44.768 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-29T16:56:44.819 INFO:teuthology.task.internal:Creating archive directory... 2023-07-29T16:56:44.819 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:56:44.823 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:56:44.826 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:56:44.829 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:56:44.861 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-29T16:56:44.872 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-29T16:56:44.872 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:56:44.894 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:56:44.896 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:56:44.899 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:56:44.928 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.935 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.938 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.940 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.941 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.946 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.955 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.957 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:56:44.958 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-29T16:56:44.971 INFO:teuthology.task.internal:Configuring sudo... 2023-07-29T16:56:44.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:56:44.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:56:44.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:56:45.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:56:45.034 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-29T16:56:45.051 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-29T16:56:45.052 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:56:45.064 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:56:45.067 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:56:45.076 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:56:45.096 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.226 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.362 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T16:56:45.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:56:45.431 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.525 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.648 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T16:56:45.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:56:45.714 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.768 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:45.819 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.909 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:45.951 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T16:56:45.951 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:56:46.019 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:46.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:56:46.130 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:46.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:56:46.222 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T16:56:46.223 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:56:46.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-07-29T16:56:46.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-07-29T16:56:46.301 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-07-29T16:56:46.303 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-07-29T16:56:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:56:46.377 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:56:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:56:46.412 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:56:46.790 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-29T16:56:46.807 INFO:teuthology.task.internal:Starting timer... 2023-07-29T16:56:46.807 INFO:teuthology.run_tasks:Running task pcp... 2023-07-29T16:56:46.828 INFO:teuthology.run_tasks:Running task selinux... 2023-07-29T16:56:46.860 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-29T16:56:46.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-07-29T16:56:46.934 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-07-29T16:56:46.936 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-07-29T16:56:47.835 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-07-29T16:56:47.872 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2023-07-29T16:56:47.971 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: 2023-07-29T16:56:47.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-07-29T16:56:48.045 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-07-29T16:56:48.046 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-29T16:56:48.047 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-07-29T16:56:48.083 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-07-29T16:56:48.083 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-07-29T16:56:48.419 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-07-29T16:56:48.420 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2023-07-29T16:56:48.455 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2023-07-29T16:56:48.455 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-07-29T16:56:48.481 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-07-29T16:56:48.482 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2023-07-29T16:56:48.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:56:48.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:56:48.512 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:56:48.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:56:48.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:56:48.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:56:48.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:56:48.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:56:48.598 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-29T16:56:48.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:56:48.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:56:48.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:56:48.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:56:48.818 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-29T16:56:48.833 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-29T16:56:48.835 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-29T16:56:48.865 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-29T16:56:48.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi093.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-29T17:04:15.969 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-07-29T17:04:15.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T17:04:15.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T17:04:16.044 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-29T17:04:16.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-29T17:04:16.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T17:04:16.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T17:04:16.184 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-29T17:04:16.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-29T17:04:16.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T17:04:16.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T17:04:16.320 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-29T17:04:16.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T17:04:16.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T17:04:16.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T17:04:16.464 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-29T17:04:16.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-29T17:04:16.538 INFO:teuthology.run_tasks:Running task clock... 2023-07-29T17:04:16.556 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-29T17:04:16.556 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T17:04:16.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:04:16.559 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T17:04:16.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:04:16.562 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T17:04:16.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:04:16.564 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T17:04:16.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:04:16.593 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T17:04:16.594 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T17:04:16.595 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T17:04:16.607 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T17:04:16.608 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T17:04:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T17:04:16.612 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T17:04:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T17:04:16.671 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2023-07-29T17:04:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-07-29T17:04:16.682 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2023-07-29T17:04:16.685 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-07-29T17:04:16.690 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-07-29T17:04:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-07-29T17:04:16.696 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T17:04:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-07-29T17:04:16.705 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T17:04:16.707 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-07-29T17:04:16.710 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T17:04:16.710 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T17:04:16.719 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T17:04:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T17:04:16.723 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T17:04:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T17:04:16.779 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-07-29T17:04:16.783 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:04:16.783 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-07-29T17:04:16.783 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.783 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.784 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.784 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.796 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-07-29T17:04:16.799 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:04:16.799 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-07-29T17:04:16.799 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.800 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.800 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.800 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.800 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-07-29T17:04:16.804 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:04:16.804 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-07-29T17:04:16.804 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.805 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.805 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.805 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-07-29T17:04:16.812 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:04:16.813 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-07-29T17:04:16.813 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.813 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.813 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.813 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:04:16.814 INFO:teuthology.run_tasks:Running task install... 2023-07-29T17:04:16.829 DEBUG:teuthology.task.install:project ceph 2023-07-29T17:04:16.830 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}} 2023-07-29T17:04:16.830 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'} 2023-07-29T17:04:16.830 INFO:teuthology.task.install:Using flavor: default 2023-07-29T17:04:16.837 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-29T17:04:16.838 INFO:teuthology.task.install:extra packages: [] 2023-07-29T17:04:16.838 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T17:04:16.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:04:16.841 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T17:04:16.841 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:04:16.842 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T17:04:16.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:04:16.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T17:04:16.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:04:17.162 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T17:04:17.162 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T17:04:17.170 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T17:04:17.170 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T17:04:17.178 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T17:04:17.178 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T17:04:17.184 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T17:04:17.185 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T17:04:17.530 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T17:04:17.530 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:04:17.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T17:04:17.535 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T17:04:17.535 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:04:17.536 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T17:04:17.546 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T17:04:17.546 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:04:17.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T17:04:17.552 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T17:04:17.552 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:04:17.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T17:04:17.564 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T17:04:17.564 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T17:04:17.565 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T17:04:17.566 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T17:04:17.581 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T17:04:17.581 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T17:04:17.582 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T17:04:17.583 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T17:04:17.635 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T17:04:17.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T17:04:17.652 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T17:04:17.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T17:04:17.714 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T17:04:17.720 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T17:04:17.730 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T17:04:17.736 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T17:04:17.781 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2023-07-29T17:04:17.782 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2023-07-29T17:04:17.790 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-07-29T17:04:17.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-07-29T17:04:17.797 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-07-29T17:04:17.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-07-29T17:04:17.805 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-07-29T17:04:17.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-07-29T17:04:18.053 INFO:teuthology.orchestra.run.smithi093.stdout:73 files removed 2023-07-29T17:04:18.064 INFO:teuthology.orchestra.run.smithi073.stdout:73 files removed 2023-07-29T17:04:18.071 INFO:teuthology.orchestra.run.smithi153.stdout:73 files removed 2023-07-29T17:04:18.073 INFO:teuthology.orchestra.run.smithi092.stdout:73 files removed 2023-07-29T17:04:18.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T17:04:18.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T17:04:18.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T17:04:18.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T17:04:19.937 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 56 kB/s | 80 kB 00:01 2023-07-29T17:04:19.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 55 kB/s | 80 kB 00:01 2023-07-29T17:04:20.452 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 41 kB/s | 80 kB 00:01 2023-07-29T17:04:20.622 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 38 kB/s | 80 kB 00:02 2023-07-29T17:04:20.654 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-29T17:04:20.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-29T17:04:21.144 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-29T17:04:21.322 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-29T17:04:21.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-29T17:04:21.369 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-07-29T17:04:21.820 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-29T17:04:21.990 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-29T17:04:49.167 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - AppStream 1.1 MB/s | 31 MB 00:27 2023-07-29T17:04:55.136 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 931 kB/s | 31 MB 00:33 2023-07-29T17:04:56.942 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 41 MB 00:02 2023-07-29T17:05:03.525 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-07-29T17:05:04.075 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-29T17:05:06.487 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 7.2 MB/s | 41 MB 00:05 2023-07-29T17:05:08.261 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - AppStream 670 kB/s | 31 MB 00:46 2023-07-29T17:05:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 8 - PowerTools 1.4 MB/s | 6.3 MB 00:04 2023-07-29T17:05:09.536 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - AppStream 661 kB/s | 31 MB 00:47 2023-07-29T17:05:10.144 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-07-29T17:05:12.960 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2023-07-29T17:05:13.728 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.6 kB 00:00 2023-07-29T17:05:15.828 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 41 MB 00:01 2023-07-29T17:05:22.203 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-07-29T17:05:22.629 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 6.6 kB 00:00 2023-07-29T17:05:22.645 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - PowerTools 734 kB/s | 6.3 MB 00:08 2023-07-29T17:05:24.204 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-29T17:05:24.637 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - BaseOS 4.3 MB/s | 41 MB 00:09 2023-07-29T17:05:27.313 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 8 - PowerTools 1.4 MB/s | 6.3 MB 00:04 2023-07-29T17:05:28.284 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 889 kB/s | 16 MB 00:17 2023-07-29T17:05:28.765 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-07-29T17:05:30.574 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2023-07-29T17:05:31.187 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2023-07-29T17:05:31.921 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-29T17:05:32.084 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 387 kB/s | 24 kB 00:00 2023-07-29T17:05:34.365 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 323 kB/s | 24 kB 00:00 2023-07-29T17:05:35.973 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:35.973 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:36.162 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-07-29T17:05:36.174 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================================ 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================================ 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T17:05:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T17:05:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T17:05:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T17:05:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T17:05:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T17:05:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T17:05:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T17:05:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T17:05:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T17:05:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T17:05:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T17:05:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-29T17:05:36.180 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-29T17:05:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-29T17:05:36.182 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T17:05:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T17:05:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T17:05:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T17:05:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-29T17:05:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T17:05:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-29T17:05:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-29T17:05:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-29T17:05:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T17:05:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-29T17:05:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T17:05:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T17:05:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-29T17:05:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T17:05:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-29T17:05:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T17:05:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T17:05:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-29T17:05:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================================ 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:Install 121 Packages 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 13 Packages 2023-07-29T17:05:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:05:36.197 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 200 M 2023-07-29T17:05:36.197 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-07-29T17:05:37.103 INFO:teuthology.orchestra.run.smithi092.stdout:(1/134): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 20 kB/s | 6.4 kB 00:00 2023-07-29T17:05:37.652 INFO:teuthology.orchestra.run.smithi092.stdout:(2/134): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.5 MB/s | 847 kB 00:00 2023-07-29T17:05:37.814 INFO:teuthology.orchestra.run.smithi092.stdout:(3/134): ceph-immutable-object-cache-18.1.3-11. 1.0 MB/s | 165 kB 00:00 2023-07-29T17:05:37.894 INFO:teuthology.orchestra.run.smithi092.stdout:(4/134): ceph-base-18.1.3-11.g0484097b.el8.x86_ 4.8 MB/s | 5.4 MB 00:01 2023-07-29T17:05:38.238 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:38.238 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:38.411 INFO:teuthology.orchestra.run.smithi092.stdout:(5/134): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 3.0 MB/s | 1.5 MB 00:00 2023-07-29T17:05:38.426 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-07-29T17:05:38.438 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================================ 2023-07-29T17:05:38.438 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================================ 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T17:05:38.439 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T17:05:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T17:05:38.441 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T17:05:38.442 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-29T17:05:38.443 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-29T17:05:38.444 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T17:05:38.445 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T17:05:38.446 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T17:05:38.447 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-29T17:05:38.448 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-29T17:05:38.449 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T17:05:38.450 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-29T17:05:38.451 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T17:05:38.452 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-29T17:05:38.453 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-29T17:05:38.454 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T17:05:38.455 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-29T17:05:38.456 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================================ 2023-07-29T17:05:38.457 INFO:teuthology.orchestra.run.smithi093.stdout:Install 121 Packages 2023-07-29T17:05:38.458 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 13 Packages 2023-07-29T17:05:38.458 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:05:38.458 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 200 M 2023-07-29T17:05:38.459 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-07-29T17:05:38.480 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 8 - PowerTools 1.0 MB/s | 6.3 MB 00:06 2023-07-29T17:05:38.678 INFO:teuthology.orchestra.run.smithi092.stdout:(6/134): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 2.6 MB/s | 2.3 MB 00:00 2023-07-29T17:05:39.028 INFO:teuthology.orchestra.run.smithi092.stdout:(7/134): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 7.5 MB/s | 4.6 MB 00:00 2023-07-29T17:05:39.317 INFO:teuthology.orchestra.run.smithi093.stdout:(1/134): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2023-07-29T17:05:39.812 INFO:teuthology.orchestra.run.smithi092.stdout:(8/134): ceph-common-18.1.3-11.g0484097b.el8.x8 7.1 MB/s | 22 MB 00:03 2023-07-29T17:05:39.962 INFO:teuthology.orchestra.run.smithi092.stdout:(9/134): ceph-selinux-18.1.3-11.g0484097b.el8.x 162 kB/s | 24 kB 00:00 2023-07-29T17:05:39.984 INFO:teuthology.orchestra.run.smithi093.stdout:(2/134): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.2 MB/s | 847 kB 00:00 2023-07-29T17:05:40.031 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-29T17:05:40.384 INFO:teuthology.orchestra.run.smithi093.stdout:(3/134): ceph-base-18.1.3-11.g0484097b.el8.x86_ 3.8 MB/s | 5.4 MB 00:01 2023-07-29T17:05:40.734 INFO:teuthology.orchestra.run.smithi093.stdout:(4/134): ceph-immutable-object-cache-18.1.3-11. 221 kB/s | 165 kB 00:00 2023-07-29T17:05:40.776 INFO:teuthology.orchestra.run.smithi093.stdout:(5/134): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 5.8 MB/s | 2.3 MB 00:00 2023-07-29T17:05:40.796 INFO:teuthology.orchestra.run.smithi092.stdout:(10/134): ceph-radosgw-18.1.3-11.g0484097b.el8. 7.4 MB/s | 13 MB 00:01 2023-07-29T17:05:40.913 INFO:teuthology.orchestra.run.smithi092.stdout:(11/134): libcephfs-devel-18.1.3-11.g0484097b.e 262 kB/s | 30 kB 00:00 2023-07-29T17:05:41.147 INFO:teuthology.orchestra.run.smithi092.stdout:(12/134): libcephfs2-18.1.3-11.g0484097b.el8.x8 3.2 MB/s | 769 kB 00:00 2023-07-29T17:05:41.272 INFO:teuthology.orchestra.run.smithi092.stdout:(13/134): libcephsqlite-18.1.3-11.g0484097b.el8 1.1 MB/s | 137 kB 00:00 2023-07-29T17:05:41.364 INFO:teuthology.orchestra.run.smithi092.stdout:(14/134): librados-devel-18.1.3-11.g0484097b.el 1.5 MB/s | 139 kB 00:00 2023-07-29T17:05:41.435 INFO:teuthology.orchestra.run.smithi093.stdout:(6/134): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 7.0 MB/s | 4.6 MB 00:00 2023-07-29T17:05:41.489 INFO:teuthology.orchestra.run.smithi092.stdout:(15/134): libradosstriper1-18.1.3-11.g0484097b. 3.7 MB/s | 474 kB 00:00 2023-07-29T17:05:41.610 INFO:teuthology.orchestra.run.smithi093.stdout:(7/134): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 1.8 MB/s | 1.5 MB 00:00 2023-07-29T17:05:41.766 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2023-07-29T17:05:42.409 INFO:teuthology.orchestra.run.smithi092.stdout:(16/134): librgw2-18.1.3-11.g0484097b.el8.x86_6 7.1 MB/s | 6.5 MB 00:00 2023-07-29T17:05:42.514 INFO:teuthology.orchestra.run.smithi092.stdout:(17/134): python3-ceph-argparse-18.1.3-11.g0484 425 kB/s | 45 kB 00:00 2023-07-29T17:05:42.673 INFO:teuthology.orchestra.run.smithi092.stdout:(18/134): python3-ceph-common-18.1.3-11.g048409 749 kB/s | 119 kB 00:00 2023-07-29T17:05:42.790 INFO:teuthology.orchestra.run.smithi092.stdout:(19/134): python3-cephfs-18.1.3-11.g0484097b.el 1.6 MB/s | 190 kB 00:00 2023-07-29T17:05:42.899 INFO:teuthology.orchestra.run.smithi092.stdout:(20/134): python3-rados-18.1.3-11.g0484097b.el8 3.3 MB/s | 371 kB 00:00 2023-07-29T17:05:43.016 INFO:teuthology.orchestra.run.smithi092.stdout:(21/134): python3-rbd-18.1.3-11.g0484097b.el8.x 3.0 MB/s | 364 kB 00:00 2023-07-29T17:05:43.158 INFO:teuthology.orchestra.run.smithi092.stdout:(22/134): python3-rgw-18.1.3-11.g0484097b.el8.x 753 kB/s | 107 kB 00:00 2023-07-29T17:05:43.258 INFO:teuthology.orchestra.run.smithi092.stdout:(23/134): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 944 kB/s | 94 kB 00:00 2023-07-29T17:05:43.867 INFO:teuthology.orchestra.run.smithi092.stdout:(24/134): rbd-mirror-18.1.3-11.g0484097b.el8.x8 5.7 MB/s | 3.4 MB 00:00 2023-07-29T17:05:43.959 INFO:teuthology.orchestra.run.smithi092.stdout:(25/134): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.9 MB/s | 179 kB 00:00 2023-07-29T17:05:44.092 INFO:teuthology.orchestra.run.smithi092.stdout:(26/134): ceph-grafana-dashboards-18.1.3-11.g04 173 kB/s | 23 kB 00:00 2023-07-29T17:05:44.193 INFO:teuthology.orchestra.run.smithi092.stdout:(27/134): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.2 MB/s | 127 kB 00:00 2023-07-29T17:05:44.460 INFO:teuthology.orchestra.run.smithi092.stdout:(28/134): ceph-mgr-dashboard-18.1.3-11.g0484097 6.4 MB/s | 1.7 MB 00:00 2023-07-29T17:05:44.819 INFO:teuthology.orchestra.run.smithi093.stdout:(8/134): ceph-common-18.1.3-11.g0484097b.el8.x8 3.7 MB/s | 22 MB 00:05 2023-07-29T17:05:44.927 INFO:teuthology.orchestra.run.smithi093.stdout:(9/134): ceph-selinux-18.1.3-11.g0484097b.el8.x 224 kB/s | 24 kB 00:00 2023-07-29T17:05:45.219 INFO:teuthology.orchestra.run.smithi093.stdout:(10/134): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 4.7 MB/s | 18 MB 00:03 2023-07-29T17:05:45.277 INFO:teuthology.orchestra.run.smithi092.stdout:(29/134): ceph-mgr-diskprediction-local-18.1.3- 9.1 MB/s | 7.4 MB 00:00 2023-07-29T17:05:45.294 INFO:teuthology.orchestra.run.smithi093.stdout:(11/134): libcephfs-devel-18.1.3-11.g0484097b.e 409 kB/s | 30 kB 00:00 2023-07-29T17:05:45.402 INFO:teuthology.orchestra.run.smithi092.stdout:(30/134): ceph-mgr-modules-core-18.1.3-11.g0484 1.9 MB/s | 240 kB 00:00 2023-07-29T17:05:45.486 INFO:teuthology.orchestra.run.smithi093.stdout:(12/134): libcephfs2-18.1.3-11.g0484097b.el8.x8 3.9 MB/s | 769 kB 00:00 2023-07-29T17:05:45.494 INFO:teuthology.orchestra.run.smithi092.stdout:(31/134): ceph-mgr-rook-18.1.3-11.g0484097b.el8 517 kB/s | 47 kB 00:00 2023-07-29T17:05:45.586 INFO:teuthology.orchestra.run.smithi093.stdout:(13/134): libcephsqlite-18.1.3-11.g0484097b.el8 1.3 MB/s | 137 kB 00:00 2023-07-29T17:05:45.591 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 369 kB/s | 24 kB 00:00 2023-07-29T17:05:45.602 INFO:teuthology.orchestra.run.smithi092.stdout:(32/134): ceph-prometheus-alerts-18.1.3-11.g048 134 kB/s | 15 kB 00:00 2023-07-29T17:05:45.678 INFO:teuthology.orchestra.run.smithi093.stdout:(14/134): librados-devel-18.1.3-11.g0484097b.el 1.5 MB/s | 139 kB 00:00 2023-07-29T17:05:45.770 INFO:teuthology.orchestra.run.smithi092.stdout:(33/134): ceph-volume-18.1.3-11.g0484097b.el8.n 1.5 MB/s | 258 kB 00:00 2023-07-29T17:05:45.820 INFO:teuthology.orchestra.run.smithi093.stdout:(15/134): libradosstriper1-18.1.3-11.g0484097b. 3.3 MB/s | 474 kB 00:00 2023-07-29T17:05:45.839 INFO:teuthology.orchestra.run.smithi092.stdout:(34/134): cephadm-18.1.3-11.g0484097b.el8.noarc 2.3 MB/s | 160 kB 00:00 2023-07-29T17:05:46.979 INFO:teuthology.orchestra.run.smithi093.stdout:(16/134): librgw2-18.1.3-11.g0484097b.el8.x86_6 5.6 MB/s | 6.5 MB 00:01 2023-07-29T17:05:47.054 INFO:teuthology.orchestra.run.smithi093.stdout:(17/134): python3-ceph-argparse-18.1.3-11.g0484 597 kB/s | 45 kB 00:00 2023-07-29T17:05:47.099 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 703 kB/s | 16 MB 00:22 2023-07-29T17:05:47.146 INFO:teuthology.orchestra.run.smithi093.stdout:(18/134): python3-ceph-common-18.1.3-11.g048409 1.3 MB/s | 119 kB 00:00 2023-07-29T17:05:47.213 INFO:teuthology.orchestra.run.smithi093.stdout:(19/134): python3-cephfs-18.1.3-11.g0484097b.el 2.8 MB/s | 190 kB 00:00 2023-07-29T17:05:47.347 INFO:teuthology.orchestra.run.smithi093.stdout:(20/134): python3-rados-18.1.3-11.g0484097b.el8 2.7 MB/s | 371 kB 00:00 2023-07-29T17:05:47.363 INFO:teuthology.orchestra.run.smithi092.stdout:(35/134): automake-1.16.1-7.el8.noarch.rpm 468 kB/s | 713 kB 00:01 2023-07-29T17:05:47.472 INFO:teuthology.orchestra.run.smithi093.stdout:(21/134): python3-rbd-18.1.3-11.g0484097b.el8.x 2.8 MB/s | 364 kB 00:00 2023-07-29T17:05:47.564 INFO:teuthology.orchestra.run.smithi093.stdout:(22/134): python3-rgw-18.1.3-11.g0484097b.el8.x 1.1 MB/s | 107 kB 00:00 2023-07-29T17:05:47.639 INFO:teuthology.orchestra.run.smithi093.stdout:(23/134): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 1.2 MB/s | 94 kB 00:00 2023-07-29T17:05:47.948 INFO:teuthology.orchestra.run.smithi093.stdout:(24/134): ceph-radosgw-18.1.3-11.g0484097b.el8. 2.1 MB/s | 13 MB 00:06 2023-07-29T17:05:48.098 INFO:teuthology.orchestra.run.smithi093.stdout:(25/134): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.2 MB/s | 179 kB 00:00 2023-07-29T17:05:48.182 INFO:teuthology.orchestra.run.smithi093.stdout:(26/134): ceph-grafana-dashboards-18.1.3-11.g04 277 kB/s | 23 kB 00:00 2023-07-29T17:05:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:(36/134): bison-3.0.4-10.el8.x86_64.rpm 818 kB/s | 688 kB 00:00 2023-07-29T17:05:48.349 INFO:teuthology.orchestra.run.smithi093.stdout:(27/134): rbd-mirror-18.1.3-11.g0484097b.el8.x8 4.9 MB/s | 3.4 MB 00:00 2023-07-29T17:05:48.375 INFO:teuthology.orchestra.run.smithi093.stdout:(28/134): ceph-mgr-cephadm-18.1.3-11.g0484097b. 663 kB/s | 127 kB 00:00 2023-07-29T17:05:48.530 INFO:teuthology.orchestra.run.smithi092.stdout:(37/134): flex-2.6.1-9.el8.x86_64.rpm 984 kB/s | 320 kB 00:00 2023-07-29T17:05:48.839 INFO:teuthology.orchestra.run.smithi092.stdout:(38/134): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 1.7 MB/s | 18 MB 00:10 2023-07-29T17:05:48.864 INFO:teuthology.orchestra.run.smithi092.stdout:(39/134): jq-1.6-7.el8.x86_64.rpm 607 kB/s | 202 kB 00:00 2023-07-29T17:05:49.016 INFO:teuthology.orchestra.run.smithi093.stdout:(29/134): ceph-mgr-dashboard-18.1.3-11.g0484097 2.5 MB/s | 1.7 MB 00:00 2023-07-29T17:05:49.133 INFO:teuthology.orchestra.run.smithi093.stdout:(30/134): ceph-mgr-modules-core-18.1.3-11.g0484 2.0 MB/s | 240 kB 00:00 2023-07-29T17:05:49.208 INFO:teuthology.orchestra.run.smithi093.stdout:(31/134): ceph-mgr-rook-18.1.3-11.g0484097b.el8 635 kB/s | 47 kB 00:00 2023-07-29T17:05:49.276 INFO:teuthology.orchestra.run.smithi093.stdout:(32/134): ceph-prometheus-alerts-18.1.3-11.g048 218 kB/s | 15 kB 00:00 2023-07-29T17:05:49.323 INFO:teuthology.orchestra.run.smithi092.stdout:(40/134): libtool-2.4.6-25.el8.x86_64.rpm 1.5 MB/s | 709 kB 00:00 2023-07-29T17:05:49.401 INFO:teuthology.orchestra.run.smithi093.stdout:(33/134): ceph-mgr-diskprediction-local-18.1.3- 7.2 MB/s | 7.4 MB 00:01 2023-07-29T17:05:49.426 INFO:teuthology.orchestra.run.smithi093.stdout:(34/134): ceph-volume-18.1.3-11.g0484097b.el8.n 1.7 MB/s | 258 kB 00:00 2023-07-29T17:05:49.468 INFO:teuthology.orchestra.run.smithi093.stdout:(35/134): cephadm-18.1.3-11.g0484097b.el8.noarc 2.3 MB/s | 160 kB 00:00 2023-07-29T17:05:49.515 INFO:teuthology.orchestra.run.smithi092.stdout:(41/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-07-29T17:05:49.529 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:49.530 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:49.599 INFO:teuthology.orchestra.run.smithi092.stdout:(42/134): librdkafka-0.11.4-3.el8.x86_64.rpm 466 kB/s | 354 kB 00:00 2023-07-29T17:05:49.707 INFO:teuthology.orchestra.run.smithi092.stdout:(43/134): oniguruma-6.8.2-2.el8.x86_64.rpm 976 kB/s | 187 kB 00:00 2023-07-29T17:05:49.716 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-07-29T17:05:49.728 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================================ 2023-07-29T17:05:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================================ 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T17:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T17:05:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T17:05:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T17:05:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-29T17:05:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-29T17:05:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T17:05:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-29T17:05:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T17:05:49.737 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-29T17:05:49.738 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-29T17:05:49.739 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T17:05:49.740 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T17:05:49.741 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-29T17:05:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-29T17:05:49.743 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-29T17:05:49.744 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T17:05:49.745 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-29T17:05:49.746 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================================ 2023-07-29T17:05:49.747 INFO:teuthology.orchestra.run.smithi073.stdout:Install 121 Packages 2023-07-29T17:05:49.748 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 13 Packages 2023-07-29T17:05:49.748 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:05:49.748 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 200 M 2023-07-29T17:05:49.748 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-07-29T17:05:50.292 INFO:teuthology.orchestra.run.smithi073.stdout:(1/134): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 23 kB/s | 6.4 kB 00:00 2023-07-29T17:05:50.660 INFO:teuthology.orchestra.run.smithi093.stdout:(36/134): automake-1.16.1-7.el8.noarch.rpm 578 kB/s | 713 kB 00:01 2023-07-29T17:05:50.685 INFO:teuthology.orchestra.run.smithi093.stdout:(37/134): bison-3.0.4-10.el8.x86_64.rpm 566 kB/s | 688 kB 00:01 2023-07-29T17:05:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 435 kB/s | 24 kB 00:00 2023-07-29T17:05:50.967 INFO:teuthology.orchestra.run.smithi073.stdout:(2/134): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.2 MB/s | 847 kB 00:00 2023-07-29T17:05:51.027 INFO:teuthology.orchestra.run.smithi093.stdout:(38/134): jq-1.6-7.el8.x86_64.rpm 593 kB/s | 202 kB 00:00 2023-07-29T17:05:51.103 INFO:teuthology.orchestra.run.smithi093.stdout:(39/134): flex-2.6.1-9.el8.x86_64.rpm 723 kB/s | 320 kB 00:00 2023-07-29T17:05:51.126 INFO:teuthology.orchestra.run.smithi073.stdout:(3/134): ceph-immutable-object-cache-18.1.3-11. 1.0 MB/s | 165 kB 00:00 2023-07-29T17:05:51.394 INFO:teuthology.orchestra.run.smithi093.stdout:(40/134): librdkafka-0.11.4-3.el8.x86_64.rpm 964 kB/s | 354 kB 00:00 2023-07-29T17:05:51.424 INFO:teuthology.orchestra.run.smithi092.stdout:(44/134): openblas-threads-0.3.15-4.el8.x86_64. 2.8 MB/s | 4.9 MB 00:01 2023-07-29T17:05:51.611 INFO:teuthology.orchestra.run.smithi093.stdout:(41/134): libtool-2.4.6-25.el8.x86_64.rpm 1.4 MB/s | 709 kB 00:00 2023-07-29T17:05:51.662 INFO:teuthology.orchestra.run.smithi093.stdout:(42/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 972 kB/s | 259 kB 00:00 2023-07-29T17:05:51.804 INFO:teuthology.orchestra.run.smithi093.stdout:(43/134): oniguruma-6.8.2-2.el8.x86_64.rpm 976 kB/s | 187 kB 00:00 2023-07-29T17:05:51.943 INFO:teuthology.orchestra.run.smithi073.stdout:(4/134): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 2.8 MB/s | 2.3 MB 00:00 2023-07-29T17:05:52.044 INFO:teuthology.orchestra.run.smithi073.stdout:(5/134): ceph-base-18.1.3-11.g0484097b.el8.x86_ 2.6 MB/s | 5.4 MB 00:02 2023-07-29T17:05:52.369 INFO:teuthology.orchestra.run.smithi073.stdout:(6/134): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 3.6 MB/s | 1.5 MB 00:00 2023-07-29T17:05:52.658 INFO:teuthology.orchestra.run.smithi092.stdout:(45/134): ceph-test-18.1.3-11.g0484097b.el8.x86 3.7 MB/s | 47 MB 00:12 2023-07-29T17:05:52.716 INFO:teuthology.orchestra.run.smithi092.stdout:(46/134): python3-babel-2.5.1-7.el8.noarch.rpm 3.7 MB/s | 4.8 MB 00:01 2023-07-29T17:05:52.783 INFO:teuthology.orchestra.run.smithi092.stdout:(47/134): openblas-0.3.15-4.el8.x86_64.rpm 1.5 MB/s | 4.7 MB 00:03 2023-07-29T17:05:52.825 INFO:teuthology.orchestra.run.smithi092.stdout:(48/134): python3-jsonpatch-1.21-2.el8.noarch.r 244 kB/s | 27 kB 00:00 2023-07-29T17:05:52.852 INFO:teuthology.orchestra.run.smithi073.stdout:(7/134): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 5.7 MB/s | 4.6 MB 00:00 2023-07-29T17:05:52.900 INFO:teuthology.orchestra.run.smithi092.stdout:(49/134): python3-jsonpointer-1.10-11.el8.noarc 170 kB/s | 20 kB 00:00 2023-07-29T17:05:52.934 INFO:teuthology.orchestra.run.smithi092.stdout:(50/134): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-07-29T17:05:53.009 INFO:teuthology.orchestra.run.smithi092.stdout:(51/134): python3-markupsafe-0.23-19.el8.x86_64 357 kB/s | 39 kB 00:00 2023-07-29T17:05:53.218 INFO:teuthology.orchestra.run.smithi092.stdout:(52/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2023-07-29T17:05:53.351 INFO:teuthology.orchestra.run.smithi092.stdout:(53/134): python3-jinja2-2.10.1-3.el8.noarch.rp 776 kB/s | 538 kB 00:00 2023-07-29T17:05:53.376 INFO:teuthology.orchestra.run.smithi092.stdout:(54/134): python3-prettytable-0.7.2-14.el8.noar 277 kB/s | 44 kB 00:00 2023-07-29T17:05:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:(55/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 826 kB/s | 103 kB 00:00 2023-07-29T17:05:53.502 INFO:teuthology.orchestra.run.smithi092.stdout:(56/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-07-29T17:05:53.602 INFO:teuthology.orchestra.run.smithi092.stdout:(57/134): python3-pyasn1-modules-0.3.7-6.el8.no 879 kB/s | 110 kB 00:00 2023-07-29T17:05:53.604 INFO:teuthology.orchestra.run.smithi093.stdout:(44/134): openblas-0.3.15-4.el8.x86_64.rpm 2.4 MB/s | 4.7 MB 00:01 2023-07-29T17:05:53.619 INFO:teuthology.orchestra.run.smithi092.stdout:(58/134): python3-pytz-2017.2-9.el8.noarch.rpm 462 kB/s | 54 kB 00:00 2023-07-29T17:05:53.662 INFO:teuthology.orchestra.run.smithi093.stdout:(45/134): openblas-threads-0.3.15-4.el8.x86_64. 2.6 MB/s | 4.9 MB 00:01 2023-07-29T17:05:53.694 INFO:teuthology.orchestra.run.smithi092.stdout:(59/134): python3-numpy-1.14.3-10.el8.x86_64.rp 4.9 MB/s | 3.7 MB 00:00 2023-07-29T17:05:53.820 INFO:teuthology.orchestra.run.smithi092.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-07-29T17:05:53.854 INFO:teuthology.orchestra.run.smithi092.stdout:(61/134): python3-werkzeug-0.12.2-4.el8.noarch. 1.9 MB/s | 457 kB 00:00 2023-07-29T17:05:53.921 INFO:teuthology.orchestra.run.smithi092.stdout:(62/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 704 kB/s | 71 kB 00:00 2023-07-29T17:05:53.955 INFO:teuthology.orchestra.run.smithi093.stdout:(46/134): python3-jinja2-2.10.1-3.el8.noarch.rp 1.8 MB/s | 538 kB 00:00 2023-07-29T17:05:53.963 INFO:teuthology.orchestra.run.smithi092.stdout:(63/134): elfutils-libelf-devel-0.189-2.el8.x86 566 kB/s | 61 kB 00:00 2023-07-29T17:05:54.046 INFO:teuthology.orchestra.run.smithi092.stdout:(64/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 577 kB/s | 48 kB 00:00 2023-07-29T17:05:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:(47/134): python3-jsonpatch-1.21-2.el8.noarch.r 246 kB/s | 27 kB 00:00 2023-07-29T17:05:54.071 INFO:teuthology.orchestra.run.smithi092.stdout:(65/134): fuse-2.9.7-17.el8.x86_64.rpm 551 kB/s | 83 kB 00:00 2023-07-29T17:05:54.114 INFO:teuthology.orchestra.run.smithi092.stdout:(66/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 449 kB/s | 19 kB 00:00 2023-07-29T17:05:54.172 INFO:teuthology.orchestra.run.smithi092.stdout:(67/134): libcom_err-devel-1.45.6-5.el8.x86_64. 666 kB/s | 39 kB 00:00 2023-07-29T17:05:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:(48/134): python3-jsonpointer-1.10-11.el8.noarc 156 kB/s | 20 kB 00:00 2023-07-29T17:05:54.197 INFO:teuthology.orchestra.run.smithi092.stdout:(68/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.6 MB/s | 561 kB 00:00 2023-07-29T17:05:54.281 INFO:teuthology.orchestra.run.smithi092.stdout:(69/134): libquadmath-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2023-07-29T17:05:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:(49/134): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-07-29T17:05:54.331 INFO:teuthology.orchestra.run.smithi092.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 942 kB/s | 47 kB 00:00 2023-07-29T17:05:54.356 INFO:teuthology.orchestra.run.smithi092.stdout:(71/134): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2023-07-29T17:05:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:(50/134): python3-markupsafe-0.23-19.el8.x86_64 333 kB/s | 39 kB 00:00 2023-07-29T17:05:54.507 INFO:teuthology.orchestra.run.smithi092.stdout:(72/134): libsepol-devel-2.9-3.el8.x86_64.rpm 580 kB/s | 87 kB 00:00 2023-07-29T17:05:54.532 INFO:teuthology.orchestra.run.smithi092.stdout:(73/134): libselinux-devel-2.9-8.el8.x86_64.rpm 999 kB/s | 200 kB 00:00 2023-07-29T17:05:54.566 INFO:teuthology.orchestra.run.smithi092.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-07-29T17:05:54.591 INFO:teuthology.orchestra.run.smithi092.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 309 kB/s | 18 kB 00:00 2023-07-29T17:05:54.616 INFO:teuthology.orchestra.run.smithi092.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 878 kB/s | 44 kB 00:00 2023-07-29T17:05:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:(51/134): python3-babel-2.5.1-7.el8.noarch.rpm 4.4 MB/s | 4.8 MB 00:01 2023-07-29T17:05:54.711 INFO:teuthology.orchestra.run.smithi073.stdout:(8/134): ceph-radosgw-18.1.3-11.g0484097b.el8.x 7.0 MB/s | 13 MB 00:01 2023-07-29T17:05:54.726 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:54.727 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T17:05:54.728 INFO:teuthology.orchestra.run.smithi092.stdout:(77/134): pcre2-devel-10.32-3.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2023-07-29T17:05:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:(52/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2023-07-29T17:05:54.800 INFO:teuthology.orchestra.run.smithi092.stdout:(78/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.1 MB/s | 229 kB 00:00 2023-07-29T17:05:54.811 INFO:teuthology.orchestra.run.smithi073.stdout:(9/134): ceph-selinux-18.1.3-11.g0484097b.el8.x 243 kB/s | 24 kB 00:00 2023-07-29T17:05:54.850 INFO:teuthology.orchestra.run.smithi092.stdout:(79/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-07-29T17:05:54.876 INFO:teuthology.orchestra.run.smithi092.stdout:(80/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-07-29T17:05:54.901 INFO:teuthology.orchestra.run.smithi092.stdout:(81/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.9 MB/s | 249 kB 00:00 2023-07-29T17:05:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 377 kB/s | 44 kB 00:00 2023-07-29T17:05:54.917 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-07-29T17:05:54.929 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-07-29T17:05:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T17:05:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T17:05:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-29T17:05:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T17:05:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-07-29T17:05:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-29T17:05:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-29T17:05:54.936 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T17:05:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T17:05:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T17:05:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-29T17:05:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T17:05:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-29T17:05:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-29T17:05:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-29T17:05:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-29T17:05:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T17:05:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T17:05:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-29T17:05:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T17:05:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T17:05:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T17:05:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-29T17:05:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-07-29T17:05:54.949 INFO:teuthology.orchestra.run.smithi153.stdout:Install 121 Packages 2023-07-29T17:05:54.950 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 13 Packages 2023-07-29T17:05:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:05:54.950 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 200 M 2023-07-29T17:05:54.950 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-07-29T17:05:54.964 INFO:teuthology.orchestra.run.smithi092.stdout:(82/134): python3-cryptography-3.2.1-6.el8.x86_ 7.1 MB/s | 641 kB 00:00 2023-07-29T17:05:54.993 INFO:teuthology.orchestra.run.smithi092.stdout:(83/134): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-07-29T17:05:54.995 INFO:teuthology.orchestra.run.smithi073.stdout:(10/134): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 6.7 MB/s | 18 MB 00:02 2023-07-29T17:05:55.018 INFO:teuthology.orchestra.run.smithi092.stdout:(84/134): python3-oauthlib-2.1.0-1.el8.noarch.r 2.8 MB/s | 155 kB 00:00 2023-07-29T17:05:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:(54/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 885 kB/s | 103 kB 00:00 2023-07-29T17:05:55.043 INFO:teuthology.orchestra.run.smithi092.stdout:(85/134): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-29T17:05:55.077 INFO:teuthology.orchestra.run.smithi092.stdout:(86/134): python3-requests-oauthlib-1.0.0-1.el8 728 kB/s | 43 kB 00:00 2023-07-29T17:05:55.103 INFO:teuthology.orchestra.run.smithi092.stdout:(87/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-07-29T17:05:55.138 INFO:teuthology.orchestra.run.smithi073.stdout:(11/134): libcephfs-devel-18.1.3-11.g0484097b.e 214 kB/s | 30 kB 00:00 2023-07-29T17:05:55.145 INFO:teuthology.orchestra.run.smithi092.stdout:(88/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 868 kB/s | 58 kB 00:00 2023-07-29T17:05:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:(55/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 948 kB/s | 126 kB 00:00 2023-07-29T17:05:55.233 INFO:teuthology.orchestra.run.smithi093.stdout:(56/134): python3-numpy-1.14.3-10.el8.x86_64.rp 4.6 MB/s | 3.7 MB 00:00 2023-07-29T17:05:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:(57/134): python3-pyasn1-modules-0.3.7-6.el8.no 942 kB/s | 110 kB 00:00 2023-07-29T17:05:55.346 INFO:teuthology.orchestra.run.smithi073.stdout:(12/134): libcephfs2-18.1.3-11.g0484097b.el8.x8 3.6 MB/s | 769 kB 00:00 2023-07-29T17:05:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:(58/134): python3-pytz-2017.2-9.el8.noarch.rpm 463 kB/s | 54 kB 00:00 2023-07-29T17:05:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:(13/134): libcephsqlite-18.1.3-11.g0484097b.el8 1.1 MB/s | 137 kB 00:00 2023-07-29T17:05:55.487 INFO:teuthology.orchestra.run.smithi092.stdout:(89/134): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2023-07-29T17:05:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:(59/134): python3-werkzeug-0.12.2-4.el8.noarch. 2.6 MB/s | 457 kB 00:00 2023-07-29T17:05:55.571 INFO:teuthology.orchestra.run.smithi073.stdout:(14/134): librados-devel-18.1.3-11.g0484097b.el 1.3 MB/s | 139 kB 00:00 2023-07-29T17:05:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-07-29T17:05:55.667 INFO:teuthology.orchestra.run.smithi092.stdout:(90/134): libunwind-1.3.1-3.el8.x86_64.rpm 416 kB/s | 75 kB 00:00 2023-07-29T17:05:55.705 INFO:teuthology.orchestra.run.smithi073.stdout:(15/134): libradosstriper1-18.1.3-11.g0484097b. 3.5 MB/s | 474 kB 00:00 2023-07-29T17:05:55.754 INFO:teuthology.orchestra.run.smithi092.stdout:(91/134): gperftools-libs-2.7-9.el8.x86_64.rpm 470 kB/s | 306 kB 00:00 2023-07-29T17:05:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:(61/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 652 kB/s | 71 kB 00:00 2023-07-29T17:05:55.763 INFO:teuthology.orchestra.run.smithi153.stdout:(1/134): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 22 kB/s | 6.4 kB 00:00 2023-07-29T17:05:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:(62/134): elfutils-libelf-devel-0.189-2.el8.x86 410 kB/s | 61 kB 00:00 2023-07-29T17:05:55.913 INFO:teuthology.orchestra.run.smithi092.stdout:(92/134): python3-scipy-1.0.0-21.module_el8.5.0 5.9 MB/s | 14 MB 00:02 2023-07-29T17:05:55.938 INFO:teuthology.orchestra.run.smithi092.stdout:(93/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 238 kB/s | 44 kB 00:00 2023-07-29T17:05:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:(63/134): fuse-2.9.7-17.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-07-29T17:05:56.005 INFO:teuthology.orchestra.run.smithi092.stdout:(94/134): python3-cachetools-3.1.1-4.el8.noarch 495 kB/s | 33 kB 00:00 2023-07-29T17:05:56.055 INFO:teuthology.orchestra.run.smithi092.stdout:(95/134): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-07-29T17:05:56.072 INFO:teuthology.orchestra.run.smithi092.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-07-29T17:05:56.089 INFO:teuthology.orchestra.run.smithi073.stdout:(16/134): ceph-common-18.1.3-11.g0484097b.el8.x 3.6 MB/s | 22 MB 00:06 2023-07-29T17:05:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:(64/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2023-07-29T17:05:56.180 INFO:teuthology.orchestra.run.smithi092.stdout:(97/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-07-29T17:05:56.205 INFO:teuthology.orchestra.run.smithi073.stdout:(17/134): python3-ceph-argparse-18.1.3-11.g0484 383 kB/s | 45 kB 00:00 2023-07-29T17:05:56.256 INFO:teuthology.orchestra.run.smithi092.stdout:(98/134): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-07-29T17:05:56.281 INFO:teuthology.orchestra.run.smithi092.stdout:(99/134): python3-beautifulsoup4-4.6.3-2.el8.1. 504 kB/s | 185 kB 00:00 2023-07-29T17:05:56.323 INFO:teuthology.orchestra.run.smithi092.stdout:(100/134): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-29T17:05:56.348 INFO:teuthology.orchestra.run.smithi092.stdout:(101/134): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-07-29T17:05:56.356 INFO:teuthology.orchestra.run.smithi073.stdout:(18/134): python3-ceph-common-18.1.3-11.g048409 791 kB/s | 119 kB 00:00 2023-07-29T17:05:56.415 INFO:teuthology.orchestra.run.smithi092.stdout:(102/134): python3-cherrypy-18.4.0-1.el8.noarch 1.1 MB/s | 384 kB 00:00 2023-07-29T17:05:56.439 INFO:teuthology.orchestra.run.smithi073.stdout:(19/134): librgw2-18.1.3-11.g0484097b.el8.x86_6 8.9 MB/s | 6.5 MB 00:00 2023-07-29T17:05:56.441 INFO:teuthology.orchestra.run.smithi092.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 531 kB/s | 49 kB 00:00 2023-07-29T17:05:56.465 INFO:teuthology.orchestra.run.smithi073.stdout:(20/134): python3-cephfs-18.1.3-11.g0484097b.el 1.7 MB/s | 190 kB 00:00 2023-07-29T17:05:56.516 INFO:teuthology.orchestra.run.smithi092.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 587 kB/s | 59 kB 00:00 2023-07-29T17:05:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:(65/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.3 MB/s | 561 kB 00:00 2023-07-29T17:05:56.540 INFO:teuthology.orchestra.run.smithi073.stdout:(21/134): python3-rados-18.1.3-11.g0484097b.el8 3.6 MB/s | 371 kB 00:00 2023-07-29T17:05:56.541 INFO:teuthology.orchestra.run.smithi092.stdout:(105/134): python3-natsort-7.1.1-2.el8.noarch.r 601 kB/s | 60 kB 00:00 2023-07-29T17:05:56.574 INFO:teuthology.orchestra.run.smithi073.stdout:(22/134): python3-rbd-18.1.3-11.g0484097b.el8.x 3.3 MB/s | 364 kB 00:00 2023-07-29T17:05:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:(66/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 281 kB/s | 19 kB 00:00 2023-07-29T17:05:56.641 INFO:teuthology.orchestra.run.smithi073.stdout:(23/134): python3-rgw-18.1.3-11.g0484097b.el8.x 1.0 MB/s | 107 kB 00:00 2023-07-29T17:05:56.650 INFO:teuthology.orchestra.run.smithi092.stdout:(106/134): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-07-29T17:05:56.666 INFO:teuthology.orchestra.run.smithi073.stdout:(24/134): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 1.0 MB/s | 94 kB 00:00 2023-07-29T17:05:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:(67/134): libcom_err-devel-1.45.6-5.el8.x86_64. 582 kB/s | 39 kB 00:00 2023-07-29T17:05:56.680 INFO:teuthology.orchestra.run.smithi153.stdout:(2/134): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 925 kB/s | 847 kB 00:00 2023-07-29T17:05:56.758 INFO:teuthology.orchestra.run.smithi092.stdout:(107/134): python3-repoze-lru-0.7-6.el8.noarch. 311 kB/s | 34 kB 00:00 2023-07-29T17:05:56.792 INFO:teuthology.orchestra.run.smithi092.stdout:(108/134): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-07-29T17:05:56.816 INFO:teuthology.orchestra.run.smithi073.stdout:(25/134): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.2 MB/s | 179 kB 00:00 2023-07-29T17:05:56.892 INFO:teuthology.orchestra.run.smithi092.stdout:(109/134): python3-rsa-4.9-2.el8.noarch.rpm 642 kB/s | 64 kB 00:00 2023-07-29T17:05:56.917 INFO:teuthology.orchestra.run.smithi073.stdout:(26/134): ceph-grafana-dashboards-18.1.3-11.g04 230 kB/s | 23 kB 00:00 2023-07-29T17:05:56.934 INFO:teuthology.orchestra.run.smithi092.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 1.1 MB/s | 196 kB 00:00 2023-07-29T17:05:56.972 INFO:teuthology.orchestra.run.smithi153.stdout:(3/134): ceph-immutable-object-cache-18.1.3-11. 567 kB/s | 165 kB 00:00 2023-07-29T17:05:56.976 INFO:teuthology.orchestra.run.smithi092.stdout:(111/134): python3-simplegeneric-0.8.1-17.el8.n 224 kB/s | 19 kB 00:00 2023-07-29T17:05:57.017 INFO:teuthology.orchestra.run.smithi073.stdout:(27/134): rbd-mirror-18.1.3-11.g0484097b.el8.x8 9.2 MB/s | 3.4 MB 00:00 2023-07-29T17:05:57.017 INFO:teuthology.orchestra.run.smithi092.stdout:(112/134): python3-kubernetes-11.0.0-6.el8.noar 1.7 MB/s | 1.2 MB 00:00 2023-07-29T17:05:57.042 INFO:teuthology.orchestra.run.smithi073.stdout:(28/134): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.0 MB/s | 127 kB 00:00 2023-07-29T17:05:57.043 INFO:teuthology.orchestra.run.smithi092.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 219 kB/s | 24 kB 00:00 2023-07-29T17:05:57.110 INFO:teuthology.orchestra.run.smithi092.stdout:(114/134): python3-trustme-0.6.0-4.el8.noarch.r 299 kB/s | 27 kB 00:00 2023-07-29T17:05:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:(68/134): python3-scipy-1.0.0-21.module_el8.5.0 7.5 MB/s | 14 MB 00:01 2023-07-29T17:05:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:(69/134): libgfortran-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2023-07-29T17:05:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 940 kB/s | 47 kB 00:00 2023-07-29T17:05:57.210 INFO:teuthology.orchestra.run.smithi092.stdout:(115/134): python3-waitress-1.4.3-1.el8.noarch. 1.5 MB/s | 255 kB 00:00 2023-07-29T17:05:57.217 INFO:teuthology.orchestra.run.smithi073.stdout:(29/134): ceph-mgr-dashboard-18.1.3-11.g0484097 8.5 MB/s | 1.7 MB 00:00 2023-07-29T17:05:57.235 INFO:teuthology.orchestra.run.smithi092.stdout:(116/134): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-07-29T17:05:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:(71/134): libquadmath-8.5.0-20.el8.x86_64.rpm 794 kB/s | 172 kB 00:00 2023-07-29T17:05:57.337 INFO:teuthology.orchestra.run.smithi092.stdout:(117/134): python3-websocket-client-0.56.0-5.el 483 kB/s | 61 kB 00:00 2023-07-29T17:05:57.343 INFO:teuthology.orchestra.run.smithi073.stdout:(30/134): ceph-mgr-modules-core-18.1.3-11.g0484 1.9 MB/s | 240 kB 00:00 2023-07-29T17:05:57.354 INFO:teuthology.orchestra.run.smithi093.stdout:(72/134): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-07-29T17:05:57.369 INFO:teuthology.orchestra.run.smithi092.stdout:(118/134): python3-tempora-1.14.1-5.el8.noarch. 74 kB/s | 29 kB 00:00 2023-07-29T17:05:57.395 INFO:teuthology.orchestra.run.smithi092.stdout:(119/134): python3-webtest-2.0.33-1.el8.noarch. 537 kB/s | 85 kB 00:00 2023-07-29T17:05:57.428 INFO:teuthology.orchestra.run.smithi092.stdout:(120/134): python3-zc-lockfile-2.0-2.el8.noarch 253 kB/s | 23 kB 00:00 2023-07-29T17:05:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:(73/134): libsepol-devel-2.9-3.el8.x86_64.rpm 869 kB/s | 87 kB 00:00 2023-07-29T17:05:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 997 kB/s | 99 kB 00:00 2023-07-29T17:05:57.468 INFO:teuthology.orchestra.run.smithi073.stdout:(31/134): ceph-mgr-rook-18.1.3-11.g0484097b.el8 379 kB/s | 47 kB 00:00 2023-07-29T17:05:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2023-07-29T17:05:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 403 kB/s | 44 kB 00:00 2023-07-29T17:05:57.568 INFO:teuthology.orchestra.run.smithi073.stdout:(32/134): ceph-prometheus-alerts-18.1.3-11.g048 145 kB/s | 15 kB 00:00 2023-07-29T17:05:57.669 INFO:teuthology.orchestra.run.smithi073.stdout:(33/134): ceph-volume-18.1.3-11.g0484097b.el8.n 2.5 MB/s | 258 kB 00:00 2023-07-29T17:05:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:(34/134): cephadm-18.1.3-11.g0484097b.el8.noarc 1.4 MB/s | 160 kB 00:00 2023-07-29T17:05:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:(77/134): pcre2-devel-10.32-3.el8.x86_64.rpm 1.4 MB/s | 605 kB 00:00 2023-07-29T17:05:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:(78/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-07-29T17:05:58.336 INFO:teuthology.orchestra.run.smithi073.stdout:(35/134): ceph-mgr-diskprediction-local-18.1.3- 5.7 MB/s | 7.4 MB 00:01 2023-07-29T17:05:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:(79/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 519 kB/s | 220 kB 00:00 2023-07-29T17:05:58.637 INFO:teuthology.orchestra.run.smithi092.stdout:(121/134): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.9 MB/s | 3.6 MB 00:01 2023-07-29T17:05:58.812 INFO:teuthology.orchestra.run.smithi092.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 434 kB/s | 76 kB 00:00 2023-07-29T17:05:58.871 INFO:teuthology.orchestra.run.smithi092.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 3.9 MB/s | 232 kB 00:00 2023-07-29T17:05:58.895 INFO:teuthology.orchestra.run.smithi073.stdout:(36/134): automake-1.16.1-7.el8.noarch.rpm 639 kB/s | 713 kB 00:01 2023-07-29T17:05:58.969 INFO:teuthology.orchestra.run.smithi092.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 3.0 MB/s | 302 kB 00:00 2023-07-29T17:05:58.997 INFO:teuthology.orchestra.run.smithi153.stdout:(4/134): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 1.1 MB/s | 2.3 MB 00:02 2023-07-29T17:05:59.071 INFO:teuthology.orchestra.run.smithi092.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2023-07-29T17:05:59.222 INFO:teuthology.orchestra.run.smithi092.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-07-29T17:05:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:(80/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 355 kB/s | 249 kB 00:00 2023-07-29T17:05:59.237 INFO:teuthology.orchestra.run.smithi073.stdout:(37/134): flex-2.6.1-9.el8.x86_64.rpm 935 kB/s | 320 kB 00:00 2023-07-29T17:05:59.297 INFO:teuthology.orchestra.run.smithi092.stdout:(127/134): libmount-2.32.1-42.el8.x86_64.rpm 3.1 MB/s | 236 kB 00:00 2023-07-29T17:05:59.339 INFO:teuthology.orchestra.run.smithi092.stdout:(128/134): thrift-0.13.0-2.el8.x86_64.rpm 902 kB/s | 1.7 MB 00:01 2023-07-29T17:05:59.364 INFO:teuthology.orchestra.run.smithi092.stdout:(129/134): libsmartcols-2.32.1-42.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-07-29T17:05:59.389 INFO:teuthology.orchestra.run.smithi092.stdout:(130/134): libuuid-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 98 kB 00:00 2023-07-29T17:05:59.462 INFO:teuthology.orchestra.run.smithi073.stdout:(38/134): jq-1.6-7.el8.x86_64.rpm 901 kB/s | 202 kB 00:00 2023-07-29T17:05:59.473 INFO:teuthology.orchestra.run.smithi092.stdout:(131/134): util-linux-user-2.32.1-42.el8.x86_64 1.2 MB/s | 102 kB 00:00 2023-07-29T17:05:59.531 INFO:teuthology.orchestra.run.smithi092.stdout:(132/134): util-linux-2.32.1-42.el8.x86_64.rpm 16 MB/s | 2.6 MB 00:00 2023-07-29T17:05:59.554 INFO:teuthology.orchestra.run.smithi073.stdout:(39/134): bison-3.0.4-10.el8.x86_64.rpm 565 kB/s | 688 kB 00:01 2023-07-29T17:05:59.615 INFO:teuthology.orchestra.run.smithi092.stdout:(133/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.6 MB/s | 1.1 MB 00:00 2023-07-29T17:05:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:(81/134): python3-cryptography-3.2.1-6.el8.x86_ 1.3 MB/s | 641 kB 00:00 2023-07-29T17:05:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:(82/134): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-29T17:05:59.813 INFO:teuthology.orchestra.run.smithi073.stdout:(40/134): librdkafka-0.11.4-3.el8.x86_64.rpm 1.0 MB/s | 354 kB 00:00 2023-07-29T17:05:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:(83/134): python3-oauthlib-2.1.0-1.el8.noarch.r 1.7 MB/s | 155 kB 00:00 2023-07-29T17:05:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:(84/134): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-07-29T17:06:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:(85/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.3 MB/s | 3.2 MB 00:02 2023-07-29T17:06:00.030 INFO:teuthology.orchestra.run.smithi073.stdout:(41/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-07-29T17:06:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:(86/134): python3-requests-oauthlib-1.0.0-1.el8 640 kB/s | 43 kB 00:00 2023-07-29T17:06:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:(87/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 892 kB/s | 74 kB 00:00 2023-07-29T17:06:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:(88/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 693 kB/s | 58 kB 00:00 2023-07-29T17:06:00.139 INFO:teuthology.orchestra.run.smithi153.stdout:(5/134): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 1.4 MB/s | 1.5 MB 00:01 2023-07-29T17:06:00.255 INFO:teuthology.orchestra.run.smithi073.stdout:(42/134): oniguruma-6.8.2-2.el8.x86_64.rpm 834 kB/s | 187 kB 00:00 2023-07-29T17:06:00.399 INFO:teuthology.orchestra.run.smithi092.stdout:(134/134): librados2-18.1.3-11.g0484097b.el8.x8 1.2 MB/s | 3.7 MB 00:03 2023-07-29T17:06:00.404 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-07-29T17:06:00.404 INFO:teuthology.orchestra.run.smithi092.stdout:Total 8.3 MB/s | 200 MB 00:24 2023-07-29T17:06:00.547 INFO:teuthology.orchestra.run.smithi073.stdout:(43/134): libtool-2.4.6-25.el8.x86_64.rpm 714 kB/s | 709 kB 00:00 2023-07-29T17:06:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:(89/134): ceph-test-18.1.3-11.g0484097b.el8.x86 3.0 MB/s | 47 MB 00:15 2023-07-29T17:06:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:(90/134): libunwind-1.3.1-3.el8.x86_64.rpm 201 kB/s | 75 kB 00:00 2023-07-29T17:06:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:(91/134): gperftools-libs-2.7-9.el8.x86_64.rpm 356 kB/s | 306 kB 00:00 2023-07-29T17:06:00.981 INFO:teuthology.orchestra.run.smithi153.stdout:(6/134): ceph-base-18.1.3-11.g0484097b.el8.x86_ 1.0 MB/s | 5.4 MB 00:05 2023-07-29T17:06:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:(92/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 523 kB/s | 44 kB 00:00 2023-07-29T17:06:01.135 INFO:teuthology.orchestra.run.smithi093.stdout:(93/134): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-07-29T17:06:01.160 INFO:teuthology.orchestra.run.smithi093.stdout:(94/134): liboath-2.6.2-3.el8.x86_64.rpm 56 kB/s | 59 kB 00:01 2023-07-29T17:06:01.180 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-07-29T17:06:01.185 INFO:teuthology.orchestra.run.smithi093.stdout:(95/134): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-07-29T17:06:01.228 INFO:teuthology.orchestra.run.smithi093.stdout:(96/134): python3-cachetools-3.1.1-4.el8.noarch 358 kB/s | 33 kB 00:00 2023-07-29T17:06:01.403 INFO:teuthology.orchestra.run.smithi093.stdout:(97/134): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-07-29T17:06:01.478 INFO:teuthology.orchestra.run.smithi093.stdout:(98/134): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-07-29T17:06:01.545 INFO:teuthology.orchestra.run.smithi093.stdout:(99/134): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-07-29T17:06:01.600 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-07-29T17:06:01.601 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-07-29T17:06:01.612 INFO:teuthology.orchestra.run.smithi093.stdout:(100/134): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-07-29T17:06:01.646 INFO:teuthology.orchestra.run.smithi093.stdout:(101/134): python3-cheroot-8.5.2-1.el8.noarch.r 375 kB/s | 173 kB 00:00 2023-07-29T17:06:01.712 INFO:teuthology.orchestra.run.smithi093.stdout:(102/134): python3-logutils-0.3.5-11.el8.noarch 731 kB/s | 49 kB 00:00 2023-07-29T17:06:01.814 INFO:teuthology.orchestra.run.smithi093.stdout:(103/134): python3-more-itertools-7.2.0-3.el8.n 584 kB/s | 59 kB 00:00 2023-07-29T17:06:01.888 INFO:teuthology.orchestra.run.smithi093.stdout:(104/134): python3-natsort-7.1.1-2.el8.noarch.r 811 kB/s | 60 kB 00:00 2023-07-29T17:06:01.930 INFO:teuthology.orchestra.run.smithi093.stdout:(105/134): python3-kubernetes-11.0.0-6.el8.noar 3.7 MB/s | 1.2 MB 00:00 2023-07-29T17:06:01.989 INFO:teuthology.orchestra.run.smithi093.stdout:(106/134): python3-certifi-2018.10.15-7.el8.noa 20 kB/s | 16 kB 00:00 2023-07-29T17:06:02.014 INFO:teuthology.orchestra.run.smithi093.stdout:(107/134): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-07-29T17:06:02.039 INFO:teuthology.orchestra.run.smithi093.stdout:(108/134): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-07-29T17:06:02.082 INFO:teuthology.orchestra.run.smithi093.stdout:(109/134): python3-routes-2.4.1-12.el8.noarch.r 2.9 MB/s | 196 kB 00:00 2023-07-29T17:06:02.106 INFO:teuthology.orchestra.run.smithi093.stdout:(110/134): python3-rsa-4.9-2.el8.noarch.rpm 961 kB/s | 64 kB 00:00 2023-07-29T17:06:02.157 INFO:teuthology.orchestra.run.smithi093.stdout:(111/134): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2023-07-29T17:06:02.182 INFO:teuthology.orchestra.run.smithi093.stdout:(112/134): python3-singledispatch-3.4.0.3-18.el 316 kB/s | 24 kB 00:00 2023-07-29T17:06:02.250 INFO:teuthology.orchestra.run.smithi093.stdout:(113/134): python3-tempora-1.14.1-5.el8.noarch. 313 kB/s | 29 kB 00:00 2023-07-29T17:06:02.283 INFO:teuthology.orchestra.run.smithi093.stdout:(114/134): python3-repoze-lru-0.7-6.el8.noarch. 114 kB/s | 34 kB 00:00 2023-07-29T17:06:02.308 INFO:teuthology.orchestra.run.smithi093.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-07-29T17:06:02.350 INFO:teuthology.orchestra.run.smithi093.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 2.5 MB/s | 255 kB 00:00 2023-07-29T17:06:02.400 INFO:teuthology.orchestra.run.smithi093.stdout:(117/134): python3-websocket-client-0.56.0-5.el 667 kB/s | 61 kB 00:00 2023-07-29T17:06:02.437 INFO:teuthology.orchestra.run.smithi073.stdout:(44/134): openblas-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.7 MB 00:02 2023-07-29T17:06:02.442 INFO:teuthology.orchestra.run.smithi093.stdout:(118/134): python3-webtest-2.0.33-1.el8.noarch. 930 kB/s | 85 kB 00:00 2023-07-29T17:06:02.492 INFO:teuthology.orchestra.run.smithi093.stdout:(119/134): python3-zc-lockfile-2.0-2.el8.noarch 250 kB/s | 23 kB 00:00 2023-07-29T17:06:02.573 INFO:teuthology.orchestra.run.smithi153.stdout:(7/134): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 1.9 MB/s | 4.6 MB 00:02 2023-07-29T17:06:02.959 INFO:teuthology.orchestra.run.smithi093.stdout:(120/134): thrift-0.13.0-2.el8.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2023-07-29T17:06:02.960 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-07-29T17:06:02.963 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-07-29T17:06:03.064 INFO:teuthology.orchestra.run.smithi073.stdout:(45/134): ceph-test-18.1.3-11.g0484097b.el8.x86 5.7 MB/s | 47 MB 00:08 2023-07-29T17:06:03.410 INFO:teuthology.orchestra.run.smithi093.stdout:(121/134): python3-webob-1.8.5-1.el8.1.noarch.r 223 kB/s | 251 kB 00:01 2023-07-29T17:06:03.651 INFO:teuthology.orchestra.run.smithi093.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 314 kB/s | 76 kB 00:00 2023-07-29T17:06:03.835 INFO:teuthology.orchestra.run.smithi093.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-07-29T17:06:03.890 INFO:teuthology.orchestra.run.smithi073.stdout:(46/134): python3-jinja2-2.10.1-3.el8.noarch.rp 652 kB/s | 538 kB 00:00 2023-07-29T17:06:04.235 INFO:teuthology.orchestra.run.smithi093.stdout:(124/134): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.8 MB/s | 3.6 MB 00:01 2023-07-29T17:06:04.419 INFO:teuthology.orchestra.run.smithi093.stdout:(125/134): elfutils-libs-0.189-2.el8.x86_64.rpm 518 kB/s | 302 kB 00:00 2023-07-29T17:06:04.511 INFO:teuthology.orchestra.run.smithi093.stdout:(126/134): libblkid-2.32.1-42.el8.x86_64.rpm 800 kB/s | 220 kB 00:00 2023-07-29T17:06:04.570 INFO:teuthology.orchestra.run.smithi093.stdout:(127/134): librados2-18.1.3-11.g0484097b.el8.x8 1.8 MB/s | 3.7 MB 00:02 2023-07-29T17:06:04.582 INFO:teuthology.orchestra.run.smithi073.stdout:(47/134): python3-jsonpatch-1.21-2.el8.noarch.r 38 kB/s | 27 kB 00:00 2023-07-29T17:06:04.603 INFO:teuthology.orchestra.run.smithi093.stdout:(128/134): libfdisk-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2023-07-29T17:06:04.670 INFO:teuthology.orchestra.run.smithi093.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 98 kB 00:00 2023-07-29T17:06:04.695 INFO:teuthology.orchestra.run.smithi093.stdout:(130/134): libmount-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 236 kB 00:00 2023-07-29T17:06:04.707 INFO:teuthology.orchestra.run.smithi073.stdout:(48/134): python3-jsonpointer-1.10-11.el8.noarc 160 kB/s | 20 kB 00:00 2023-07-29T17:06:04.833 INFO:teuthology.orchestra.run.smithi073.stdout:(49/134): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-07-29T17:06:04.871 INFO:teuthology.orchestra.run.smithi093.stdout:(131/134): util-linux-user-2.32.1-42.el8.x86_64 585 kB/s | 102 kB 00:00 2023-07-29T17:06:04.954 INFO:teuthology.orchestra.run.smithi093.stdout:(132/134): libsmartcols-2.32.1-42.el8.x86_64.rp 466 kB/s | 179 kB 00:00 2023-07-29T17:06:04.974 INFO:teuthology.orchestra.run.smithi073.stdout:(50/134): python3-markupsafe-0.23-19.el8.x86_64 274 kB/s | 39 kB 00:00 2023-07-29T17:06:05.154 INFO:teuthology.orchestra.run.smithi093.stdout:(133/134): util-linux-2.32.1-42.el8.x86_64.rpm 5.4 MB/s | 2.6 MB 00:00 2023-07-29T17:06:05.502 INFO:teuthology.orchestra.run.smithi073.stdout:(51/134): python3-babel-2.5.1-7.el8.noarch.rpm 1.6 MB/s | 4.8 MB 00:03 2023-07-29T17:06:05.738 INFO:teuthology.orchestra.run.smithi093.stdout:(134/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2023-07-29T17:06:05.742 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-07-29T17:06:05.742 INFO:teuthology.orchestra.run.smithi093.stdout:Total 7.3 MB/s | 200 MB 00:27 2023-07-29T17:06:05.850 INFO:teuthology.orchestra.run.smithi073.stdout:(52/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 647 kB/s | 225 kB 00:00 2023-07-29T17:06:05.975 INFO:teuthology.orchestra.run.smithi073.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 352 kB/s | 44 kB 00:00 2023-07-29T17:06:06.151 INFO:teuthology.orchestra.run.smithi073.stdout:(54/134): python3-numpy-1.14.3-10.el8.x86_64.rp 3.2 MB/s | 3.7 MB 00:01 2023-07-29T17:06:06.176 INFO:teuthology.orchestra.run.smithi073.stdout:(55/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 516 kB/s | 103 kB 00:00 2023-07-29T17:06:06.276 INFO:teuthology.orchestra.run.smithi073.stdout:(56/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-07-29T17:06:06.401 INFO:teuthology.orchestra.run.smithi073.stdout:(57/134): python3-pyasn1-modules-0.3.7-6.el8.no 488 kB/s | 110 kB 00:00 2023-07-29T17:06:06.427 INFO:teuthology.orchestra.run.smithi073.stdout:(58/134): python3-pytz-2017.2-9.el8.noarch.rpm 360 kB/s | 54 kB 00:00 2023-07-29T17:06:06.554 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-07-29T17:06:06.652 INFO:teuthology.orchestra.run.smithi073.stdout:(59/134): python3-werkzeug-0.12.2-4.el8.noarch. 2.0 MB/s | 457 kB 00:00 2023-07-29T17:06:06.786 INFO:teuthology.orchestra.run.smithi073.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-07-29T17:06:06.886 INFO:teuthology.orchestra.run.smithi073.stdout:(61/134): openblas-threads-0.3.15-4.el8.x86_64. 784 kB/s | 4.9 MB 00:06 2023-07-29T17:06:06.912 INFO:teuthology.orchestra.run.smithi073.stdout:(62/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 563 kB/s | 71 kB 00:00 2023-07-29T17:06:06.976 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-07-29T17:06:06.977 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-07-29T17:06:07.045 INFO:teuthology.orchestra.run.smithi073.stdout:(63/134): elfutils-libelf-devel-0.189-2.el8.x86 388 kB/s | 61 kB 00:00 2023-07-29T17:06:07.071 INFO:teuthology.orchestra.run.smithi073.stdout:(64/134): fuse-2.9.7-17.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2023-07-29T17:06:07.263 INFO:teuthology.orchestra.run.smithi073.stdout:(65/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 221 kB/s | 48 kB 00:00 2023-07-29T17:06:07.354 INFO:teuthology.orchestra.run.smithi073.stdout:(66/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 204 kB/s | 19 kB 00:00 2023-07-29T17:06:07.446 INFO:teuthology.orchestra.run.smithi073.stdout:(67/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-07-29T17:06:07.472 INFO:teuthology.orchestra.run.smithi073.stdout:(68/134): libcom_err-devel-1.45.6-5.el8.x86_64. 331 kB/s | 39 kB 00:00 2023-07-29T17:06:07.705 INFO:teuthology.orchestra.run.smithi073.stdout:(69/134): libquadmath-8.5.0-20.el8.x86_64.rpm 739 kB/s | 172 kB 00:00 2023-07-29T17:06:07.981 INFO:teuthology.orchestra.run.smithi073.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 171 kB/s | 47 kB 00:00 2023-07-29T17:06:08.123 INFO:teuthology.orchestra.run.smithi073.stdout:(71/134): libselinux-devel-2.9-8.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-07-29T17:06:08.281 INFO:teuthology.orchestra.run.smithi073.stdout:(72/134): libgfortran-8.5.0-20.el8.x86_64.rpm 773 kB/s | 645 kB 00:00 2023-07-29T17:06:08.290 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-07-29T17:06:08.293 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-07-29T17:06:08.306 INFO:teuthology.orchestra.run.smithi073.stdout:(73/134): libsepol-devel-2.9-3.el8.x86_64.rpm 474 kB/s | 87 kB 00:00 2023-07-29T17:06:08.348 INFO:teuthology.orchestra.run.smithi073.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.5 MB/s | 99 kB 00:00 2023-07-29T17:06:08.432 INFO:teuthology.orchestra.run.smithi073.stdout:(75/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 525 kB/s | 44 kB 00:00 2023-07-29T17:06:08.458 INFO:teuthology.orchestra.run.smithi073.stdout:(76/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 120 kB/s | 18 kB 00:00 2023-07-29T17:06:08.551 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-07-29T17:06:08.756 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-29T17:06:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/147 2023-07-29T17:06:09.137 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:09.248 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:09.403 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:09.509 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:09.716 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/147 2023-07-29T17:06:09.808 INFO:teuthology.orchestra.run.smithi073.stdout:(77/134): pcre2-devel-10.32-3.el8.x86_64.rpm 448 kB/s | 605 kB 00:01 2023-07-29T17:06:09.921 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-07-29T17:06:09.983 INFO:teuthology.orchestra.run.smithi073.stdout:(78/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.0 MB/s | 3.2 MB 00:01 2023-07-29T17:06:10.008 INFO:teuthology.orchestra.run.smithi073.stdout:(79/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.1 MB/s | 229 kB 00:00 2023-07-29T17:06:10.150 INFO:teuthology.orchestra.run.smithi073.stdout:(80/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-07-29T17:06:10.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:10.209 INFO:teuthology.orchestra.run.smithi073.stdout:(81/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 249 kB 00:00 2023-07-29T17:06:10.243 INFO:teuthology.orchestra.run.smithi073.stdout:(82/134): python3-cryptography-3.2.1-6.el8.x86_ 6.8 MB/s | 641 kB 00:00 2023-07-29T17:06:10.268 INFO:teuthology.orchestra.run.smithi073.stdout:(83/134): python3-jwt-1.6.1-2.el8.noarch.rpm 727 kB/s | 43 kB 00:00 2023-07-29T17:06:10.310 INFO:teuthology.orchestra.run.smithi073.stdout:(84/134): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-07-29T17:06:10.335 INFO:teuthology.orchestra.run.smithi073.stdout:(85/134): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-07-29T17:06:10.409 INFO:teuthology.orchestra.run.smithi073.stdout:(86/134): python3-requests-oauthlib-1.0.0-1.el8 431 kB/s | 43 kB 00:00 2023-07-29T17:06:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:(87/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 529 kB/s | 58 kB 00:00 2023-07-29T17:06:10.578 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:10.579 INFO:teuthology.orchestra.run.smithi073.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 307 kB/s | 74 kB 00:00 2023-07-29T17:06:10.820 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:10.830 INFO:teuthology.orchestra.run.smithi153.stdout:(8/134): ceph-radosgw-18.1.3-11.g0484097b.el8.x 1.6 MB/s | 13 MB 00:08 2023-07-29T17:06:10.870 INFO:teuthology.orchestra.run.smithi073.stdout:(89/134): liboath-2.6.2-3.el8.x86_64.rpm 201 kB/s | 59 kB 00:00 2023-07-29T17:06:10.922 INFO:teuthology.orchestra.run.smithi153.stdout:(9/134): ceph-selinux-18.1.3-11.g0484097b.el8.x 266 kB/s | 24 kB 00:00 2023-07-29T17:06:10.978 INFO:teuthology.orchestra.run.smithi073.stdout:(90/134): gperftools-libs-2.7-9.el8.x86_64.rpm 667 kB/s | 306 kB 00:00 2023-07-29T17:06:11.029 INFO:teuthology.orchestra.run.smithi073.stdout:(91/134): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-07-29T17:06:11.121 INFO:teuthology.orchestra.run.smithi073.stdout:(92/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-07-29T17:06:11.146 INFO:teuthology.orchestra.run.smithi073.stdout:(93/134): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-07-29T17:06:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:11.255 INFO:teuthology.orchestra.run.smithi073.stdout:(94/134): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-07-29T17:06:11.288 INFO:teuthology.orchestra.run.smithi073.stdout:(95/134): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-07-29T17:06:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-07-29T17:06:11.439 INFO:teuthology.orchestra.run.smithi073.stdout:(97/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-07-29T17:06:11.464 INFO:teuthology.orchestra.run.smithi073.stdout:(98/134): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-07-29T17:06:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:11.531 INFO:teuthology.orchestra.run.smithi073.stdout:(99/134): python3-google-auth-1.1.1-10.el8.noar 884 kB/s | 81 kB 00:00 2023-07-29T17:06:11.557 INFO:teuthology.orchestra.run.smithi073.stdout:(100/134): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-07-29T17:06:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:11.616 INFO:teuthology.orchestra.run.smithi073.stdout:(101/134): python3-jaraco-functools-2.0-4.el8.n 210 kB/s | 18 kB 00:00 2023-07-29T17:06:11.716 INFO:teuthology.orchestra.run.smithi073.stdout:(102/134): python3-logutils-0.3.5-11.el8.noarch 487 kB/s | 49 kB 00:00 2023-07-29T17:06:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:11.816 INFO:teuthology.orchestra.run.smithi073.stdout:(103/134): python3-kubernetes-11.0.0-6.el8.noar 4.5 MB/s | 1.2 MB 00:00 2023-07-29T17:06:11.841 INFO:teuthology.orchestra.run.smithi073.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 468 kB/s | 59 kB 00:00 2023-07-29T17:06:11.891 INFO:teuthology.orchestra.run.smithi073.stdout:(105/134): python3-natsort-7.1.1-2.el8.noarch.r 803 kB/s | 60 kB 00:00 2023-07-29T17:06:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:11.967 INFO:teuthology.orchestra.run.smithi073.stdout:(106/134): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-07-29T17:06:11.992 INFO:teuthology.orchestra.run.smithi073.stdout:(107/134): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-07-29T17:06:12.068 INFO:teuthology.orchestra.run.smithi073.stdout:(108/134): python3-repoze-lru-0.7-6.el8.noarch. 336 kB/s | 34 kB 00:00 2023-07-29T17:06:12.151 INFO:teuthology.orchestra.run.smithi073.stdout:(109/134): python3-routes-2.4.1-12.el8.noarch.r 1.2 MB/s | 196 kB 00:00 2023-07-29T17:06:12.172 INFO:teuthology.orchestra.run.smithi153.stdout:(10/134): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 1.6 MB/s | 18 MB 00:11 2023-07-29T17:06:12.176 INFO:teuthology.orchestra.run.smithi073.stdout:(110/134): python3-rsa-4.9-2.el8.noarch.rpm 591 kB/s | 64 kB 00:00 2023-07-29T17:06:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:06:12.227 INFO:teuthology.orchestra.run.smithi073.stdout:(111/134): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-07-29T17:06:12.239 INFO:teuthology.orchestra.run.smithi153.stdout:(11/134): libcephfs-devel-18.1.3-11.g0484097b.e 460 kB/s | 30 kB 00:00 2023-07-29T17:06:12.252 INFO:teuthology.orchestra.run.smithi073.stdout:(112/134): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2023-07-29T17:06:12.344 INFO:teuthology.orchestra.run.smithi073.stdout:(113/134): python3-tempora-1.14.1-5.el8.noarch. 249 kB/s | 29 kB 00:00 2023-07-29T17:06:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:12.370 INFO:teuthology.orchestra.run.smithi073.stdout:(114/134): python3-trustme-0.6.0-4.el8.noarch.r 235 kB/s | 27 kB 00:00 2023-07-29T17:06:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:12.453 INFO:teuthology.orchestra.run.smithi073.stdout:(115/134): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-07-29T17:06:12.479 INFO:teuthology.orchestra.run.smithi073.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-07-29T17:06:12.537 INFO:teuthology.orchestra.run.smithi073.stdout:(117/134): python3-websocket-client-0.56.0-5.el 734 kB/s | 61 kB 00:00 2023-07-29T17:06:12.612 INFO:teuthology.orchestra.run.smithi073.stdout:(118/134): python3-webtest-2.0.33-1.el8.noarch. 639 kB/s | 85 kB 00:00 2023-07-29T17:06:12.630 INFO:teuthology.orchestra.run.smithi073.stdout:(119/134): python3-zc-lockfile-2.0-2.el8.noarch 249 kB/s | 23 kB 00:00 2023-07-29T17:06:12.652 INFO:teuthology.orchestra.run.smithi153.stdout:(12/134): libcephfs2-18.1.3-11.g0484097b.el8.x8 1.8 MB/s | 769 kB 00:00 2023-07-29T17:06:12.665 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 12/147 2023-07-29T17:06:12.798 INFO:teuthology.orchestra.run.smithi153.stdout:(13/134): libcephsqlite-18.1.3-11.g0484097b.el8 937 kB/s | 137 kB 00:00 2023-07-29T17:06:12.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/147 2023-07-29T17:06:12.957 INFO:teuthology.orchestra.run.smithi153.stdout:(14/134): librados-devel-18.1.3-11.g0484097b.el 879 kB/s | 139 kB 00:00 2023-07-29T17:06:13.149 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/147 2023-07-29T17:06:13.180 INFO:teuthology.orchestra.run.smithi073.stdout:(120/134): thrift-0.13.0-2.el8.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2023-07-29T17:06:13.255 INFO:teuthology.orchestra.run.smithi073.stdout:(121/134): librados2-18.1.3-11.g0484097b.el8.x8 5.9 MB/s | 3.7 MB 00:00 2023-07-29T17:06:13.257 INFO:teuthology.orchestra.run.smithi153.stdout:(15/134): libradosstriper1-18.1.3-11.g0484097b. 1.5 MB/s | 474 kB 00:00 2023-07-29T17:06:13.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:13.355 INFO:teuthology.orchestra.run.smithi073.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 759 kB/s | 76 kB 00:00 2023-07-29T17:06:13.439 INFO:teuthology.orchestra.run.smithi073.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2023-07-29T17:06:13.441 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:13.540 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-07-29T17:06:13.631 INFO:teuthology.orchestra.run.smithi073.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 1.5 MB/s | 302 kB 00:00 2023-07-29T17:06:13.636 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:13.715 INFO:teuthology.orchestra.run.smithi073.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-07-29T17:06:13.729 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-29T17:06:13.790 INFO:teuthology.orchestra.run.smithi073.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2023-07-29T17:06:13.862 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:13.874 INFO:teuthology.orchestra.run.smithi073.stdout:(127/134): libmount-2.32.1-42.el8.x86_64.rpm 2.8 MB/s | 236 kB 00:00 2023-07-29T17:06:13.937 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/147 2023-07-29T17:06:13.982 INFO:teuthology.orchestra.run.smithi073.stdout:(128/134): libsmartcols-2.32.1-42.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-07-29T17:06:14.058 INFO:teuthology.orchestra.run.smithi073.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 98 kB 00:00 2023-07-29T17:06:14.090 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:14.141 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:14.177 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:14.259 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:14.341 INFO:teuthology.orchestra.run.smithi073.stdout:(130/134): util-linux-2.32.1-42.el8.x86_64.rpm 9.2 MB/s | 2.6 MB 00:00 2023-07-29T17:06:14.382 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:14.450 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:14.459 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/147 2023-07-29T17:06:14.533 INFO:teuthology.orchestra.run.smithi153.stdout:(16/134): ceph-common-18.1.3-11.g0484097b.el8.x 1.1 MB/s | 22 MB 00:19 2023-07-29T17:06:14.614 INFO:teuthology.orchestra.run.smithi073.stdout:(131/134): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.5 MB/s | 3.6 MB 00:01 2023-07-29T17:06:14.644 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/147 2023-07-29T17:06:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/147 2023-07-29T17:06:14.699 INFO:teuthology.orchestra.run.smithi153.stdout:(17/134): python3-ceph-argparse-18.1.3-11.g0484 268 kB/s | 45 kB 00:00 2023-07-29T17:06:14.742 INFO:teuthology.orchestra.run.smithi073.stdout:(132/134): util-linux-user-2.32.1-42.el8.x86_64 255 kB/s | 102 kB 00:00 2023-07-29T17:06:14.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:14.875 INFO:teuthology.orchestra.run.smithi153.stdout:(18/134): python3-ceph-common-18.1.3-11.g048409 678 kB/s | 119 kB 00:00 2023-07-29T17:06:14.894 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-07-29T17:06:14.934 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:14.992 INFO:teuthology.orchestra.run.smithi073.stdout:(133/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.9 MB/s | 1.1 MB 00:00 2023-07-29T17:06:15.057 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:15.067 INFO:teuthology.orchestra.run.smithi153.stdout:(19/134): python3-cephfs-18.1.3-11.g0484097b.el 994 kB/s | 190 kB 00:00 2023-07-29T17:06:15.110 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:15.442 INFO:teuthology.orchestra.run.smithi153.stdout:(20/134): python3-rados-18.1.3-11.g0484097b.el8 989 kB/s | 371 kB 00:00 2023-07-29T17:06:15.498 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:15.711 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:15.715 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:15.850 INFO:teuthology.orchestra.run.smithi153.stdout:(21/134): python3-rbd-18.1.3-11.g0484097b.el8.x 891 kB/s | 364 kB 00:00 2023-07-29T17:06:15.944 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:15.967 INFO:teuthology.orchestra.run.smithi153.stdout:(22/134): python3-rgw-18.1.3-11.g0484097b.el8.x 915 kB/s | 107 kB 00:00 2023-07-29T17:06:16.105 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:16.118 INFO:teuthology.orchestra.run.smithi153.stdout:(23/134): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 629 kB/s | 94 kB 00:00 2023-07-29T17:06:16.290 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:16.415 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:16.543 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:16.615 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:16.702 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:16.735 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:16.947 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:06:17.107 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:17.196 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:17.318 INFO:teuthology.orchestra.run.smithi153.stdout:(24/134): librgw2-18.1.3-11.g0484097b.el8.x86_6 1.6 MB/s | 6.5 MB 00:04 2023-07-29T17:06:17.427 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 12/147 2023-07-29T17:06:17.439 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:17.501 INFO:teuthology.orchestra.run.smithi153.stdout:(25/134): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 979 kB/s | 179 kB 00:00 2023-07-29T17:06:17.610 INFO:teuthology.orchestra.run.smithi153.stdout:(26/134): ceph-grafana-dashboards-18.1.3-11.g04 213 kB/s | 23 kB 00:00 2023-07-29T17:06:17.645 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/147 2023-07-29T17:06:17.727 INFO:teuthology.orchestra.run.smithi153.stdout:(27/134): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.1 MB/s | 127 kB 00:00 2023-07-29T17:06:17.795 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/147 2023-07-29T17:06:17.894 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/147 2023-07-29T17:06:18.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/147 2023-07-29T17:06:18.009 INFO:teuthology.orchestra.run.smithi073.stdout:(134/134): python3-scipy-1.0.0-21.module_el8.5. 1.2 MB/s | 14 MB 00:11 2023-07-29T17:06:18.012 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-07-29T17:06:18.012 INFO:teuthology.orchestra.run.smithi073.stdout:Total 7.1 MB/s | 200 MB 00:28 2023-07-29T17:06:18.032 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:18.131 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:18.197 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 26/147 2023-07-29T17:06:18.307 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:18.438 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 27/147 2023-07-29T17:06:18.497 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:18.692 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 28/147 2023-07-29T17:06:18.760 INFO:teuthology.orchestra.run.smithi153.stdout:(28/134): ceph-mgr-dashboard-18.1.3-11.g0484097 1.6 MB/s | 1.7 MB 00:01 2023-07-29T17:06:18.792 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:18.843 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-07-29T17:06:18.895 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:18.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 29/147 2023-07-29T17:06:18.961 INFO:teuthology.orchestra.run.smithi153.stdout:(29/134): rbd-mirror-18.1.3-11.g0484097b.el8.x8 1.2 MB/s | 3.4 MB 00:02 2023-07-29T17:06:19.120 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/147 2023-07-29T17:06:19.149 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 30/147 2023-07-29T17:06:19.262 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-07-29T17:06:19.262 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-07-29T17:06:19.301 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/147 2023-07-29T17:06:19.328 INFO:teuthology.orchestra.run.smithi153.stdout:(30/134): ceph-mgr-modules-core-18.1.3-11.g0484 655 kB/s | 240 kB 00:00 2023-07-29T17:06:19.428 INFO:teuthology.orchestra.run.smithi153.stdout:(31/134): ceph-mgr-rook-18.1.3-11.g0484097b.el8 474 kB/s | 47 kB 00:00 2023-07-29T17:06:19.432 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:19.520 INFO:teuthology.orchestra.run.smithi153.stdout:(32/134): ceph-prometheus-alerts-18.1.3-11.g048 159 kB/s | 15 kB 00:00 2023-07-29T17:06:19.566 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:19.723 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:19.912 INFO:teuthology.orchestra.run.smithi153.stdout:(33/134): ceph-volume-18.1.3-11.g0484097b.el8.n 659 kB/s | 258 kB 00:00 2023-07-29T17:06:20.132 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 31/147 2023-07-29T17:06:20.195 INFO:teuthology.orchestra.run.smithi153.stdout:(34/134): cephadm-18.1.3-11.g0484097b.el8.noarc 564 kB/s | 160 kB 00:00 2023-07-29T17:06:20.316 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:20.475 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/147 2023-07-29T17:06:20.548 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:20.634 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-07-29T17:06:20.637 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-07-29T17:06:20.757 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/147 2023-07-29T17:06:20.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:21.160 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:21.306 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:22.049 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:22.382 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/147 2023-07-29T17:06:22.595 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/147 2023-07-29T17:06:22.778 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:22.802 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 26/147 2023-07-29T17:06:23.025 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 27/147 2023-07-29T17:06:23.088 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 35/147 2023-07-29T17:06:23.263 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 28/147 2023-07-29T17:06:23.319 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/147 2023-07-29T17:06:23.425 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 29/147 2023-07-29T17:06:23.584 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/147 2023-07-29T17:06:23.687 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 30/147 2023-07-29T17:06:23.816 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 38/147 2023-07-29T17:06:24.069 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 39/147 2023-07-29T17:06:24.281 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 40/147 2023-07-29T17:06:24.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 41/147 2023-07-29T17:06:24.649 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 31/147 2023-07-29T17:06:24.725 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:24.800 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:24.812 INFO:teuthology.orchestra.run.smithi153.stdout:(35/134): automake-1.16.1-7.el8.noarch.rpm 155 kB/s | 713 kB 00:04 2023-07-29T17:06:24.998 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/147 2023-07-29T17:06:25.000 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:25.067 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:25.278 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/147 2023-07-29T17:06:25.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 44/147 2023-07-29T17:06:25.473 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:25.517 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:26.022 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-07-29T17:06:26.038 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:26.223 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-29T17:06:26.293 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:26.308 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/147 2023-07-29T17:06:26.512 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/147 2023-07-29T17:06:26.658 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:26.739 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:06:26.813 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/147 2023-07-29T17:06:26.942 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:06:27.065 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 49/147 2023-07-29T17:06:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/147 2023-07-29T17:06:27.253 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:27.263 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/147 2023-07-29T17:06:27.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-07-29T17:06:27.445 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/147 2023-07-29T17:06:27.520 INFO:teuthology.orchestra.run.smithi153.stdout:(36/134): bison-3.0.4-10.el8.x86_64.rpm 254 kB/s | 688 kB 00:02 2023-07-29T17:06:27.560 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 35/147 2023-07-29T17:06:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:27.635 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/147 2023-07-29T17:06:27.773 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/147 2023-07-29T17:06:27.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/147 2023-07-29T17:06:27.981 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/147 2023-07-29T17:06:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:06:28.125 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 54/147 2023-07-29T17:06:28.159 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 38/147 2023-07-29T17:06:28.175 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:28.278 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/147 2023-07-29T17:06:28.349 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 39/147 2023-07-29T17:06:28.354 INFO:teuthology.orchestra.run.smithi153.stdout:(37/134): flex-2.6.1-9.el8.x86_64.rpm 384 kB/s | 320 kB 00:00 2023-07-29T17:06:28.497 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/147 2023-07-29T17:06:28.553 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 40/147 2023-07-29T17:06:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:06:28.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/147 2023-07-29T17:06:28.733 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:28.750 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 41/147 2023-07-29T17:06:28.846 INFO:teuthology.orchestra.run.smithi153.stdout:(38/134): jq-1.6-7.el8.x86_64.rpm 412 kB/s | 202 kB 00:00 2023-07-29T17:06:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:06:28.914 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/147 2023-07-29T17:06:28.997 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:29.083 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:29.108 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/147 2023-07-29T17:06:29.203 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:06:29.204 INFO:teuthology.orchestra.run.smithi153.stdout:(39/134): ceph-mgr-diskprediction-local-18.1.3- 725 kB/s | 7.4 MB 00:10 2023-07-29T17:06:29.255 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:29.283 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 60/147 2023-07-29T17:06:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:06:29.500 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 44/147 2023-07-29T17:06:29.517 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 61/147 2023-07-29T17:06:29.605 INFO:teuthology.orchestra.run.smithi153.stdout:(40/134): librdkafka-0.11.4-3.el8.x86_64.rpm 466 kB/s | 354 kB 00:00 2023-07-29T17:06:29.666 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:29.697 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:29.766 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:06:29.781 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 62/147 2023-07-29T17:06:30.011 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 12/147 2023-07-29T17:06:30.030 INFO:teuthology.orchestra.run.smithi153.stdout:(41/134): libtool-2.4.6-25.el8.x86_64.rpm 859 kB/s | 709 kB 00:00 2023-07-29T17:06:30.069 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 63/147 2023-07-29T17:06:30.164 INFO:teuthology.orchestra.run.smithi153.stdout:(42/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 465 kB/s | 259 kB 00:00 2023-07-29T17:06:30.215 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:30.267 INFO:teuthology.orchestra.run.smithi153.stdout:(43/134): oniguruma-6.8.2-2.el8.x86_64.rpm 794 kB/s | 187 kB 00:00 2023-07-29T17:06:30.272 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/147 2023-07-29T17:06:30.461 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 64/147 2023-07-29T17:06:30.506 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:30.512 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/147 2023-07-29T17:06:30.521 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:30.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:30.701 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/147 2023-07-29T17:06:30.745 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:06:30.766 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 65/147 2023-07-29T17:06:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:30.941 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 66/147 2023-07-29T17:06:30.991 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/147 2023-07-29T17:06:31.109 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:06:31.254 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 49/147 2023-07-29T17:06:31.396 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:31.418 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/147 2023-07-29T17:06:31.512 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:06:31.583 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/147 2023-07-29T17:06:31.707 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 67/147 2023-07-29T17:06:31.722 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/147 2023-07-29T17:06:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/147 2023-07-29T17:06:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/147 2023-07-29T17:06:31.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:32.020 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:32.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:32.060 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/147 2023-07-29T17:06:32.232 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:06:32.254 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 69/147 2023-07-29T17:06:32.318 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 54/147 2023-07-29T17:06:32.331 INFO:teuthology.orchestra.run.smithi153.stdout:(44/134): ceph-test-18.1.3-11.g0484097b.el8.x86 2.2 MB/s | 47 MB 00:21 2023-07-29T17:06:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:32.467 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/147 2023-07-29T17:06:32.489 INFO:teuthology.orchestra.run.smithi153.stdout:(45/134): openblas-threads-0.3.15-4.el8.x86_64. 2.2 MB/s | 4.9 MB 00:02 2023-07-29T17:06:32.560 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-07-29T17:06:32.653 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/147 2023-07-29T17:06:32.706 INFO:teuthology.orchestra.run.smithi153.stdout:(46/134): python3-jinja2-2.10.1-3.el8.noarch.rp 2.4 MB/s | 538 kB 00:00 2023-07-29T17:06:32.826 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/147 2023-07-29T17:06:32.832 INFO:teuthology.orchestra.run.smithi153.stdout:(47/134): python3-jsonpatch-1.21-2.el8.noarch.r 213 kB/s | 27 kB 00:00 2023-07-29T17:06:32.957 INFO:teuthology.orchestra.run.smithi153.stdout:(48/134): python3-jsonpointer-1.10-11.el8.noarc 160 kB/s | 20 kB 00:00 2023-07-29T17:06:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-07-29T17:06:33.021 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:06:33.028 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/147 2023-07-29T17:06:33.082 INFO:teuthology.orchestra.run.smithi153.stdout:(49/134): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-07-29T17:06:33.189 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/147 2023-07-29T17:06:33.216 INFO:teuthology.orchestra.run.smithi153.stdout:(50/134): python3-markupsafe-0.23-19.el8.x86_64 291 kB/s | 39 kB 00:00 2023-07-29T17:06:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-07-29T17:06:33.274 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:33.363 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 60/147 2023-07-29T17:06:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-07-29T17:06:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 61/147 2023-07-29T17:06:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-07-29T17:06:33.847 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 62/147 2023-07-29T17:06:33.892 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:06:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-07-29T17:06:34.066 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 63/147 2023-07-29T17:06:34.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:34.200 INFO:teuthology.orchestra.run.smithi153.stdout:(51/134): python3-numpy-1.14.3-10.el8.x86_64.rp 3.8 MB/s | 3.7 MB 00:00 2023-07-29T17:06:34.349 INFO:teuthology.orchestra.run.smithi153.stdout:(52/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-07-29T17:06:34.410 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 64/147 2023-07-29T17:06:34.458 INFO:teuthology.orchestra.run.smithi153.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 405 kB/s | 44 kB 00:00 2023-07-29T17:06:34.575 INFO:teuthology.orchestra.run.smithi153.stdout:(54/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 887 kB/s | 103 kB 00:00 2023-07-29T17:06:34.664 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 65/147 2023-07-29T17:06:34.700 INFO:teuthology.orchestra.run.smithi153.stdout:(55/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-07-29T17:06:34.803 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:06:34.817 INFO:teuthology.orchestra.run.smithi153.stdout:(56/134): python3-pyasn1-modules-0.3.7-6.el8.no 943 kB/s | 110 kB 00:00 2023-07-29T17:06:34.863 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 66/147 2023-07-29T17:06:34.943 INFO:teuthology.orchestra.run.smithi153.stdout:(57/134): python3-pytz-2017.2-9.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2023-07-29T17:06:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-07-29T17:06:35.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/147 2023-07-29T17:06:35.380 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/147 2023-07-29T17:06:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-07-29T17:06:35.587 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 26/147 2023-07-29T17:06:35.593 INFO:teuthology.orchestra.run.smithi153.stdout:(58/134): openblas-0.3.15-4.el8.x86_64.rpm 892 kB/s | 4.7 MB 00:05 2023-07-29T17:06:35.622 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 67/147 2023-07-29T17:06:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-07-29T17:06:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 27/147 2023-07-29T17:06:35.854 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:35.928 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:35.935 INFO:teuthology.orchestra.run.smithi153.stdout:(59/134): python3-werkzeug-0.12.2-4.el8.noarch. 1.3 MB/s | 457 kB 00:00 2023-07-29T17:06:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-07-29T17:06:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 28/147 2023-07-29T17:06:36.169 INFO:teuthology.orchestra.run.smithi153.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2023-07-29T17:06:36.184 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 69/147 2023-07-29T17:06:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 29/147 2023-07-29T17:06:36.302 INFO:teuthology.orchestra.run.smithi153.stdout:(61/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 531 kB/s | 71 kB 00:00 2023-07-29T17:06:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-07-29T17:06:36.432 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-07-29T17:06:36.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 30/147 2023-07-29T17:06:36.519 INFO:teuthology.orchestra.run.smithi153.stdout:(62/134): elfutils-libelf-devel-0.189-2.el8.x86 284 kB/s | 61 kB 00:00 2023-07-29T17:06:36.574 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-07-29T17:06:36.644 INFO:teuthology.orchestra.run.smithi153.stdout:(63/134): fuse-2.9.7-17.el8.x86_64.rpm 664 kB/s | 83 kB 00:00 2023-07-29T17:06:36.728 INFO:teuthology.orchestra.run.smithi153.stdout:(64/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 578 kB/s | 48 kB 00:00 2023-07-29T17:06:36.830 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-07-29T17:06:36.842 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-07-29T17:06:37.029 INFO:teuthology.orchestra.run.smithi153.stdout:(65/134): python3-babel-2.5.1-7.el8.noarch.rpm 1.0 MB/s | 4.8 MB 00:04 2023-07-29T17:06:37.092 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-07-29T17:06:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-07-29T17:06:37.137 INFO:teuthology.orchestra.run.smithi153.stdout:(66/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.3 MB/s | 561 kB 00:00 2023-07-29T17:06:37.205 INFO:teuthology.orchestra.run.smithi153.stdout:(67/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 106 kB/s | 19 kB 00:00 2023-07-29T17:06:37.229 INFO:teuthology.orchestra.run.smithi153.stdout:(68/134): libcom_err-devel-1.45.6-5.el8.x86_64. 421 kB/s | 39 kB 00:00 2023-07-29T17:06:37.349 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-07-29T17:06:37.371 INFO:teuthology.orchestra.run.smithi153.stdout:(69/134): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-07-29T17:06:37.438 INFO:teuthology.orchestra.run.smithi153.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 706 kB/s | 47 kB 00:00 2023-07-29T17:06:37.440 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-07-29T17:06:37.478 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 31/147 2023-07-29T17:06:37.627 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-07-29T17:06:37.796 INFO:teuthology.orchestra.run.smithi153.stdout:(71/134): libselinux-devel-2.9-8.el8.x86_64.rpm 559 kB/s | 200 kB 00:00 2023-07-29T17:06:37.847 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/147 2023-07-29T17:06:37.876 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-07-29T17:06:37.930 INFO:teuthology.orchestra.run.smithi153.stdout:(72/134): libgfortran-8.5.0-20.el8.x86_64.rpm 890 kB/s | 645 kB 00:00 2023-07-29T17:06:37.989 INFO:teuthology.orchestra.run.smithi153.stdout:(73/134): libsepol-devel-2.9-3.el8.x86_64.rpm 453 kB/s | 87 kB 00:00 2023-07-29T17:06:38.014 INFO:teuthology.orchestra.run.smithi153.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 99 kB 00:00 2023-07-29T17:06:38.031 INFO:teuthology.orchestra.run.smithi153.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 432 kB/s | 18 kB 00:00 2023-07-29T17:06:38.098 INFO:teuthology.orchestra.run.smithi153.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 525 kB/s | 44 kB 00:00 2023-07-29T17:06:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/147 2023-07-29T17:06:38.179 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-07-29T17:06:38.334 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-07-29T17:06:38.365 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:38.515 INFO:teuthology.orchestra.run.smithi153.stdout:(77/134): python3-scipy-1.0.0-21.module_el8.5.0 3.8 MB/s | 14 MB 00:03 2023-07-29T17:06:38.564 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-07-29T17:06:38.565 INFO:teuthology.orchestra.run.smithi153.stdout:(78/134): pcre2-devel-10.32-3.el8.x86_64.rpm 1.3 MB/s | 605 kB 00:00 2023-07-29T17:06:38.715 INFO:teuthology.orchestra.run.smithi153.stdout:(79/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-07-29T17:06:38.808 INFO:teuthology.orchestra.run.smithi153.stdout:(80/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 785 kB/s | 229 kB 00:00 2023-07-29T17:06:38.858 INFO:teuthology.orchestra.run.smithi153.stdout:(81/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2023-07-29T17:06:38.947 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-07-29T17:06:38.961 INFO:teuthology.orchestra.run.smithi153.stdout:(82/134): python3-jwt-1.6.1-2.el8.noarch.rpm 412 kB/s | 43 kB 00:00 2023-07-29T17:06:38.975 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-07-29T17:06:39.100 INFO:teuthology.orchestra.run.smithi153.stdout:(83/134): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-07-29T17:06:39.210 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-07-29T17:06:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:(84/134): python3-pycparser-2.14-14.el8.noarch. 595 kB/s | 109 kB 00:00 2023-07-29T17:06:39.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-07-29T17:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:(85/134): python3-requests-oauthlib-1.0.0-1.el8 641 kB/s | 43 kB 00:00 2023-07-29T17:06:39.372 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-07-29T17:06:39.375 INFO:teuthology.orchestra.run.smithi153.stdout:(86/134): python3-cryptography-3.2.1-6.el8.x86_ 1.1 MB/s | 641 kB 00:00 2023-07-29T17:06:39.476 INFO:teuthology.orchestra.run.smithi153.stdout:(87/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 581 kB/s | 58 kB 00:00 2023-07-29T17:06:39.501 INFO:teuthology.orchestra.run.smithi153.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 495 kB/s | 74 kB 00:00 2023-07-29T17:06:39.583 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-07-29T17:06:39.596 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-07-29T17:06:39.718 INFO:teuthology.orchestra.run.smithi153.stdout:(89/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.9 MB/s | 3.2 MB 00:01 2023-07-29T17:06:39.824 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-07-29T17:06:39.907 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-07-29T17:06:40.026 INFO:teuthology.orchestra.run.smithi153.stdout:(90/134): liboath-2.6.2-3.el8.x86_64.rpm 112 kB/s | 59 kB 00:00 2023-07-29T17:06:40.036 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-07-29T17:06:40.151 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:06:40.213 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-07-29T17:06:40.252 INFO:teuthology.orchestra.run.smithi153.stdout:(91/134): gperftools-libs-2.7-9.el8.x86_64.rpm 395 kB/s | 306 kB 00:00 2023-07-29T17:06:40.269 INFO:teuthology.orchestra.run.smithi153.stdout:(92/134): libunwind-1.3.1-3.el8.x86_64.rpm 137 kB/s | 75 kB 00:00 2023-07-29T17:06:40.270 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-07-29T17:06:40.427 INFO:teuthology.orchestra.run.smithi153.stdout:(93/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2023-07-29T17:06:40.430 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-07-29T17:06:40.469 INFO:teuthology.orchestra.run.smithi153.stdout:(94/134): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-07-29T17:06:40.477 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 35/147 2023-07-29T17:06:40.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-07-29T17:06:40.562 INFO:teuthology.orchestra.run.smithi153.stdout:(95/134): python3-cachetools-3.1.1-4.el8.noarch 247 kB/s | 33 kB 00:00 2023-07-29T17:06:40.587 INFO:teuthology.orchestra.run.smithi153.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2023-07-29T17:06:40.612 INFO:teuthology.orchestra.run.smithi153.stdout:(97/134): python3-beautifulsoup4-4.6.3-2.el8.1. 540 kB/s | 185 kB 00:00 2023-07-29T17:06:40.672 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/147 2023-07-29T17:06:40.673 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-07-29T17:06:40.689 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-07-29T17:06:40.729 INFO:teuthology.orchestra.run.smithi153.stdout:(98/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2023-07-29T17:06:40.779 INFO:teuthology.orchestra.run.smithi153.stdout:(99/134): python3-google-auth-1.1.1-10.el8.noar 487 kB/s | 81 kB 00:00 2023-07-29T17:06:40.804 INFO:teuthology.orchestra.run.smithi153.stdout:(100/134): python3-cherrypy-18.4.0-1.el8.noarch 1.7 MB/s | 384 kB 00:00 2023-07-29T17:06:40.871 INFO:teuthology.orchestra.run.smithi153.stdout:(101/134): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-07-29T17:06:40.885 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-07-29T17:06:40.930 INFO:teuthology.orchestra.run.smithi153.stdout:(102/134): python3-jaraco-functools-2.0-4.el8.n 117 kB/s | 18 kB 00:00 2023-07-29T17:06:41.030 INFO:teuthology.orchestra.run.smithi153.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 307 kB/s | 49 kB 00:00 2023-07-29T17:06:41.089 INFO:teuthology.orchestra.run.smithi153.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 370 kB/s | 59 kB 00:00 2023-07-29T17:06:41.208 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-07-29T17:06:41.232 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/147 2023-07-29T17:06:41.422 INFO:teuthology.orchestra.run.smithi153.stdout:(105/134): python3-natsort-7.1.1-2.el8.noarch.r 154 kB/s | 60 kB 00:00 2023-07-29T17:06:41.426 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 38/147 2023-07-29T17:06:41.434 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-07-29T17:06:41.464 INFO:teuthology.orchestra.run.smithi153.stdout:(106/134): python3-pecan-1.3.2-9.el8.noarch.rpm 754 kB/s | 283 kB 00:00 2023-07-29T17:06:41.581 INFO:teuthology.orchestra.run.smithi153.stdout:(107/134): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-07-29T17:06:41.631 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-07-29T17:06:41.650 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 39/147 2023-07-29T17:06:41.827 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-07-29T17:06:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 40/147 2023-07-29T17:06:42.062 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 41/147 2023-07-29T17:06:42.073 INFO:teuthology.orchestra.run.smithi153.stdout:(108/134): python3-kubernetes-11.0.0-6.el8.noar 941 kB/s | 1.2 MB 00:01 2023-07-29T17:06:42.172 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-07-29T17:06:42.215 INFO:teuthology.orchestra.run.smithi153.stdout:(109/134): python3-repoze-lru-0.7-6.el8.noarch. 45 kB/s | 34 kB 00:00 2023-07-29T17:06:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:42.373 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:06:42.449 INFO:teuthology.orchestra.run.smithi153.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 226 kB/s | 196 kB 00:00 2023-07-29T17:06:42.449 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-07-29T17:06:42.583 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-07-29T17:06:42.590 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:42.599 INFO:teuthology.orchestra.run.smithi153.stdout:(111/134): python3-rsa-4.9-2.el8.noarch.rpm 122 kB/s | 64 kB 00:00 2023-07-29T17:06:42.695 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:06:42.741 INFO:teuthology.orchestra.run.smithi153.stdout:(112/134): python3-simplegeneric-0.8.1-17.el8.n 36 kB/s | 19 kB 00:00 2023-07-29T17:06:42.766 INFO:teuthology.orchestra.run.smithi153.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 75 kB/s | 24 kB 00:00 2023-07-29T17:06:42.777 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-07-29T17:06:42.835 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 44/147 2023-07-29T17:06:42.891 INFO:teuthology.orchestra.run.smithi153.stdout:(114/134): python3-tempora-1.14.1-5.el8.noarch. 100 kB/s | 29 kB 00:00 2023-07-29T17:06:43.038 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-07-29T17:06:43.048 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:43.150 INFO:teuthology.orchestra.run.smithi153.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 67 kB/s | 27 kB 00:00 2023-07-29T17:06:43.229 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:43.243 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-07-29T17:06:43.392 INFO:teuthology.orchestra.run.smithi153.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 408 kB/s | 255 kB 00:00 2023-07-29T17:06:43.503 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-07-29T17:06:43.591 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:06:43.671 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-07-29T17:06:43.701 INFO:teuthology.orchestra.run.smithi153.stdout:(117/134): python3-webtest-2.0.33-1.el8.noarch. 277 kB/s | 85 kB 00:00 2023-07-29T17:06:43.856 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:43.863 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-07-29T17:06:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:06:44.009 INFO:teuthology.orchestra.run.smithi153.stdout:(118/134): python3-zc-lockfile-2.0-2.el8.noarch 74 kB/s | 23 kB 00:00 2023-07-29T17:06:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/147 2023-07-29T17:06:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/147 2023-07-29T17:06:44.461 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 49/147 2023-07-29T17:06:44.642 INFO:teuthology.orchestra.run.smithi153.stdout:(119/134): python3-websocket-client-0.56.0-5.el 41 kB/s | 61 kB 00:01 2023-07-29T17:06:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/147 2023-07-29T17:06:44.798 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:06:44.903 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:06:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/147 2023-07-29T17:06:45.111 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:06:45.193 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/147 2023-07-29T17:06:45.359 INFO:teuthology.orchestra.run.smithi153.stdout:(120/134): python3-webob-1.8.5-1.el8.1.noarch.r 102 kB/s | 251 kB 00:02 2023-07-29T17:06:45.404 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/147 2023-07-29T17:06:45.619 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 54/147 2023-07-29T17:06:45.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/147 2023-07-29T17:06:45.943 INFO:teuthology.orchestra.run.smithi153.stdout:(121/134): thrift-0.13.0-2.el8.x86_64.rpm 918 kB/s | 1.7 MB 00:01 2023-07-29T17:06:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/147 2023-07-29T17:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 911 kB/s | 76 kB 00:00 2023-07-29T17:06:46.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/147 2023-07-29T17:06:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/147 2023-07-29T17:06:46.385 INFO:teuthology.orchestra.run.smithi153.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 647 kB/s | 232 kB 00:00 2023-07-29T17:06:46.400 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/147 2023-07-29T17:06:46.619 INFO:teuthology.orchestra.run.smithi153.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 1.3 MB/s | 302 kB 00:00 2023-07-29T17:06:46.679 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:46.756 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 60/147 2023-07-29T17:06:46.803 INFO:teuthology.orchestra.run.smithi153.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-07-29T17:06:47.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 61/147 2023-07-29T17:06:47.061 INFO:teuthology.orchestra.run.smithi153.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 981 kB/s | 253 kB 00:00 2023-07-29T17:06:47.276 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:06:47.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 62/147 2023-07-29T17:06:47.428 INFO:teuthology.orchestra.run.smithi153.stdout:(127/134): libmount-2.32.1-42.el8.x86_64.rpm 645 kB/s | 236 kB 00:00 2023-07-29T17:06:47.543 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 63/147 2023-07-29T17:06:47.553 INFO:teuthology.orchestra.run.smithi153.stdout:(128/134): libsmartcols-2.32.1-42.el8.x86_64.rp 1.4 MB/s | 179 kB 00:00 2023-07-29T17:06:47.584 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:06:47.645 INFO:teuthology.orchestra.run.smithi153.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 1.0 MB/s | 98 kB 00:00 2023-07-29T17:06:47.699 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:06:47.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 64/147 2023-07-29T17:06:47.934 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:06:48.223 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 65/147 2023-07-29T17:06:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 66/147 2023-07-29T17:06:49.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 67/147 2023-07-29T17:06:49.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:49.491 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:06:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:(130/134): util-linux-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 2.6 MB 00:02 2023-07-29T17:06:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 69/147 2023-07-29T17:06:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:(131/134): util-linux-user-2.32.1-42.el8.x86_64 769 kB/s | 102 kB 00:00 2023-07-29T17:06:50.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-07-29T17:06:50.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-07-29T17:06:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-07-29T17:06:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:(132/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2023-07-29T17:06:50.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-07-29T17:06:51.211 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-07-29T17:06:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-07-29T17:06:52.677 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-07-29T17:06:53.041 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-07-29T17:06:53.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-07-29T17:06:53.540 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-07-29T17:06:53.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-07-29T17:06:54.156 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-07-29T17:06:54.432 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-07-29T17:06:54.669 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-07-29T17:06:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-07-29T17:06:55.187 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-07-29T17:06:55.324 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-07-29T17:06:55.526 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-07-29T17:06:55.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-07-29T17:06:56.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-07-29T17:06:56.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-07-29T17:06:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-07-29T17:06:56.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-07-29T17:06:57.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-07-29T17:06:57.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-07-29T17:06:57.438 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-07-29T17:06:57.605 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-07-29T17:06:58.045 INFO:teuthology.orchestra.run.smithi153.stdout:(133/134): librbd1-18.1.3-11.g0484097b.el8.x86_ 287 kB/s | 3.6 MB 00:12 2023-07-29T17:06:59.520 INFO:teuthology.orchestra.run.smithi153.stdout:(134/134): librados2-18.1.3-11.g0484097b.el8.x8 252 kB/s | 3.7 MB 00:14 2023-07-29T17:06:59.526 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-07-29T17:06:59.526 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.1 MB/s | 200 MB 01:04 2023-07-29T17:07:00.234 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:00.316 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-07-29T17:07:00.496 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:00.738 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-07-29T17:07:00.738 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-07-29T17:07:01.097 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:01.426 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:07:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:07:02.094 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-07-29T17:07:02.097 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-07-29T17:07:02.319 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:07:04.034 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-07-29T17:07:04.035 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-07-29T17:07:04.036 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-07-29T17:07:04.036 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-07-29T17:07:04.036 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:07:04.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:06.023 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:06.277 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:06.496 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:06.583 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:07:06.583 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2023-07-29T17:07:06.583 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2023-07-29T17:07:06.583 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /run 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-07-29T17:07:06.584 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:07:06.701 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:06.918 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:07.155 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:07.417 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:07.441 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:07.461 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-07-29T17:07:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-29T17:07:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-07-29T17:07:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/147 2023-07-29T17:07:07.911 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-07-29T17:07:08.009 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:07:08.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:08.092 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/147 2023-07-29T17:07:08.140 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:07:08.365 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/147 2023-07-29T17:07:08.491 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:08.546 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/147 2023-07-29T17:07:08.547 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-07-29T17:07:08.723 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:08.790 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-07-29T17:07:08.809 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-07-29T17:07:08.942 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:07:08.942 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:09.143 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-07-29T17:07:09.400 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:09.567 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:07:09.597 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:09.732 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 110/147 2023-07-29T17:07:09.834 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:09.859 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:09.950 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 111/147 2023-07-29T17:07:09.987 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:07:10.083 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-07-29T17:07:10.142 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:07:10.216 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:10.296 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:07:10.345 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-07-29T17:07:10.429 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:10.464 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:07:10.517 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:10.567 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:07:10.625 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:10.676 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:10.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:07:10.887 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-07-29T17:07:11.000 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:07:11.134 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-07-29T17:07:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-07-29T17:07:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 12/147 2023-07-29T17:07:11.573 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/147 2023-07-29T17:07:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:11.639 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:11.795 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/147 2023-07-29T17:07:11.809 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:11.967 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:07:11.981 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 110/147 2023-07-29T17:07:12.072 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:07:12.173 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 111/147 2023-07-29T17:07:12.225 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:07:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 115/147 2023-07-29T17:07:12.413 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 16/147 2023-07-29T17:07:12.442 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:12.650 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:12.659 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:12.680 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:07:12.696 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:12.782 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/147 2023-07-29T17:07:12.883 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:12.893 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:12.914 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/147 2023-07-29T17:07:13.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 118/147 2023-07-29T17:07:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/147 2023-07-29T17:07:13.266 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:07:13.332 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:13.398 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/147 2023-07-29T17:07:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:07:13.875 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:14.050 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/147 2023-07-29T17:07:14.141 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:07:14.500 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 115/147 2023-07-29T17:07:14.764 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:14.800 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:14.975 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/147 2023-07-29T17:07:14.986 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:15.227 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 118/147 2023-07-29T17:07:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:07:15.367 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:15.993 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/147 2023-07-29T17:07:16.294 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/147 2023-07-29T17:07:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/147 2023-07-29T17:07:16.711 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 26/147 2023-07-29T17:07:16.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 27/147 2023-07-29T17:07:17.122 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 28/147 2023-07-29T17:07:17.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 29/147 2023-07-29T17:07:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 30/147 2023-07-29T17:07:17.764 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 31/147 2023-07-29T17:07:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/147 2023-07-29T17:07:19.113 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/147 2023-07-29T17:07:19.180 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 120/147 2023-07-29T17:07:19.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:07:19.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:19.450 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:19.690 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:19.783 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:20.035 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:20.281 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:20.374 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:21.146 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/147 2023-07-29T17:07:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:07:21.150 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-07-29T17:07:21.150 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-07-29T17:07:21.150 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-07-29T17:07:21.150 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-07-29T17:07:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 120/147 2023-07-29T17:07:21.293 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:21.447 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 35/147 2023-07-29T17:07:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:21.577 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-07-29T17:07:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/147 2023-07-29T17:07:21.691 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:21.828 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/147 2023-07-29T17:07:22.036 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:22.067 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-07-29T17:07:22.146 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 38/147 2023-07-29T17:07:22.285 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-07-29T17:07:22.291 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 39/147 2023-07-29T17:07:22.383 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:22.507 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 129/147 2023-07-29T17:07:22.562 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 40/147 2023-07-29T17:07:22.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 130/147 2023-07-29T17:07:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 41/147 2023-07-29T17:07:22.948 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:07:22.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 131/147 2023-07-29T17:07:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 42/147 2023-07-29T17:07:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:07:23.198 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-07-29T17:07:23.215 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:07:23.277 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:23.308 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 43/147 2023-07-29T17:07:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:23.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 44/147 2023-07-29T17:07:23.523 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:23.587 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-07-29T17:07:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:07:23.640 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:07:23.756 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:23.769 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:23.796 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:23.835 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:23.948 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-07-29T17:07:24.043 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-07-29T17:07:24.131 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-07-29T17:07:24.132 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:24.152 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 45/147 2023-07-29T17:07:24.220 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-07-29T17:07:24.290 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:07:24.391 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:24.392 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:24.449 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:07:24.463 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 46/147 2023-07-29T17:07:24.467 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 129/147 2023-07-29T17:07:24.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:24.508 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:07:24.627 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/147 2023-07-29T17:07:24.634 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:24.634 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:24.683 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 130/147 2023-07-29T17:07:24.783 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-07-29T17:07:24.892 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:24.901 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/147 2023-07-29T17:07:24.917 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 131/147 2023-07-29T17:07:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-07-29T17:07:25.048 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-07-29T17:07:25.130 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-07-29T17:07:25.138 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 49/147 2023-07-29T17:07:25.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:25.282 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:25.282 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:25.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/147 2023-07-29T17:07:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:07:25.373 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:25.450 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/147 2023-07-29T17:07:25.462 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:25.508 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:25.508 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:25.604 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-07-29T17:07:25.624 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/147 2023-07-29T17:07:25.683 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:25.697 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:25.716 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:25.716 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:25.844 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/147 2023-07-29T17:07:25.868 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-07-29T17:07:25.883 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-07-29T17:07:25.958 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:25.958 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:26.050 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-07-29T17:07:26.050 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 54/147 2023-07-29T17:07:26.174 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:26.174 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:26.268 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/147 2023-07-29T17:07:26.326 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:26.327 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:26.391 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:26.445 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/147 2023-07-29T17:07:26.455 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:26.585 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:26.586 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:26.597 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/147 2023-07-29T17:07:26.676 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:07:26.835 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:26.837 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/147 2023-07-29T17:07:26.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 110/147 2023-07-29T17:07:26.981 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/147 2023-07-29T17:07:27.026 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-07-29T17:07:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 111/147 2023-07-29T17:07:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 60/147 2023-07-29T17:07:27.191 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:27.191 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/147 2023-07-29T17:07:27.191 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/147 2023-07-29T17:07:27.192 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/147 2023-07-29T17:07:27.192 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/147 2023-07-29T17:07:27.192 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/147 2023-07-29T17:07:27.193 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/147 2023-07-29T17:07:27.193 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:07:27.193 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:07:27.193 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:07:27.194 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:07:27.194 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/147 2023-07-29T17:07:27.194 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/147 2023-07-29T17:07:27.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/147 2023-07-29T17:07:27.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/147 2023-07-29T17:07:27.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:07:27.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/147 2023-07-29T17:07:27.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/147 2023-07-29T17:07:27.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/147 2023-07-29T17:07:27.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/147 2023-07-29T17:07:27.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/147 2023-07-29T17:07:27.197 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/147 2023-07-29T17:07:27.198 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-07-29T17:07:27.199 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-07-29T17:07:27.200 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-07-29T17:07:27.201 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-07-29T17:07:27.202 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-07-29T17:07:27.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-07-29T17:07:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-07-29T17:07:27.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-07-29T17:07:27.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-07-29T17:07:27.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-07-29T17:07:27.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-07-29T17:07:27.205 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-07-29T17:07:27.206 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-07-29T17:07:27.207 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-07-29T17:07:27.208 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-07-29T17:07:27.209 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-07-29T17:07:27.210 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-07-29T17:07:27.211 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 122/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-07-29T17:07:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-07-29T17:07:27.213 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:27.214 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-07-29T17:07:27.215 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:27.215 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-07-29T17:07:27.215 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:27.215 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-07-29T17:07:27.242 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:27.242 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:27.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:27.393 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 61/147 2023-07-29T17:07:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:07:27.501 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:27.501 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 62/147 2023-07-29T17:07:27.706 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:27.709 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:27.709 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:27.834 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 63/147 2023-07-29T17:07:27.934 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:27.935 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:28.126 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:28.126 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:28.196 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 64/147 2023-07-29T17:07:28.326 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:28.473 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 65/147 2023-07-29T17:07:28.549 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:28.667 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:07:28.673 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 66/147 2023-07-29T17:07:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:07:29.091 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:29.091 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/147 2023-07-29T17:07:29.091 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:07:29.092 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/147 2023-07-29T17:07:29.093 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/147 2023-07-29T17:07:29.094 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/147 2023-07-29T17:07:29.095 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/147 2023-07-29T17:07:29.096 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/147 2023-07-29T17:07:29.104 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/147 2023-07-29T17:07:29.104 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/147 2023-07-29T17:07:29.104 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/147 2023-07-29T17:07:29.106 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/147 2023-07-29T17:07:29.106 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/147 2023-07-29T17:07:29.106 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/147 2023-07-29T17:07:29.106 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-07-29T17:07:29.106 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-07-29T17:07:29.107 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-07-29T17:07:29.108 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-07-29T17:07:29.109 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-07-29T17:07:29.110 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-07-29T17:07:29.111 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-07-29T17:07:29.112 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-07-29T17:07:29.113 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-07-29T17:07:29.114 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-07-29T17:07:29.115 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-07-29T17:07:29.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-07-29T17:07:29.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 122/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-07-29T17:07:29.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-07-29T17:07:29.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-07-29T17:07:29.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:29.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-07-29T17:07:29.319 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-07-29T17:07:29.319 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.320 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.321 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.323 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.324 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-7.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T17:07:29.325 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-29T17:07:29.326 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T17:07:29.327 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-29T17:07:29.327 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-29T17:07:29.327 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.327 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.327 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-29T17:07:29.328 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-29T17:07:29.329 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-29T17:07:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T17:07:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T17:07:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T17:07:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T17:07:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-29T17:07:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T17:07:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T17:07:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T17:07:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T17:07:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T17:07:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T17:07:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-29T17:07:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T17:07:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-29T17:07:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:07:29.340 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-07-29T17:07:29.342 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 115/147 2023-07-29T17:07:29.460 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 67/147 2023-07-29T17:07:29.606 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:29.637 DEBUG:teuthology.parallel:result is None 2023-07-29T17:07:29.641 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:07:29.647 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:07:29.752 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 68/147 2023-07-29T17:07:29.842 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:29.853 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:07:29.961 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 69/147 2023-07-29T17:07:30.047 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 118/147 2023-07-29T17:07:30.217 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:30.226 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-07-29T17:07:30.661 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-07-29T17:07:30.967 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-29T17:07:31.170 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.171 INFO:teuthology.orchestra.run.smithi093.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.172 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.173 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.174 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.175 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.6-7.el8.x86_64 2023-07-29T17:07:31.176 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T17:07:31.177 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-29T17:07:31.177 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-29T17:07:31.178 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T17:07:31.179 INFO:teuthology.orchestra.run.smithi093.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-29T17:07:31.180 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T17:07:31.181 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-29T17:07:31.182 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T17:07:31.183 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T17:07:31.184 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T17:07:31.185 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T17:07:31.186 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T17:07:31.187 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.188 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:31.189 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T17:07:31.189 INFO:teuthology.orchestra.run.smithi093.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T17:07:31.189 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-29T17:07:31.189 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T17:07:31.189 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-29T17:07:31.190 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:07:31.190 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-07-29T17:07:31.199 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-07-29T17:07:31.437 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-07-29T17:07:31.444 DEBUG:teuthology.parallel:result is None 2023-07-29T17:07:31.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-07-29T17:07:32.788 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-07-29T17:07:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-07-29T17:07:33.388 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-07-29T17:07:33.640 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-07-29T17:07:33.979 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-07-29T17:07:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-07-29T17:07:34.474 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-07-29T17:07:34.651 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:07:34.733 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-07-29T17:07:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-07-29T17:07:35.243 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-07-29T17:07:35.448 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-07-29T17:07:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-07-29T17:07:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-07-29T17:07:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 120/147 2023-07-29T17:07:36.276 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-07-29T17:07:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:36.339 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:07:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-07-29T17:07:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-07-29T17:07:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-07-29T17:07:36.905 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:07:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-07-29T17:07:37.142 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:37.234 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:07:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-07-29T17:07:37.538 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-07-29T17:07:37.722 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-07-29T17:07:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:38.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-07-29T17:07:38.646 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:38.827 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-07-29T17:07:39.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-07-29T17:07:39.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 129/147 2023-07-29T17:07:39.508 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 130/147 2023-07-29T17:07:39.693 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 131/147 2023-07-29T17:07:39.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-07-29T17:07:40.191 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:40.299 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:07:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:40.508 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:40.522 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:07:40.717 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-07-29T17:07:40.912 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-07-29T17:07:40.912 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:41.202 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:07:41.202 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:07:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:41.601 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 97/147 2023-07-29T17:07:41.726 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:07:41.888 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:07:41.937 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-07-29T17:07:41.997 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 98/147 2023-07-29T17:07:42.151 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:42.151 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:42.235 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:07:42.401 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:07:42.402 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:42.643 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:42.643 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:42.885 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:07:42.885 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:43.118 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:43.118 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:43.376 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:07:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:07:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/147 2023-07-29T17:07:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/147 2023-07-29T17:07:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:07:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/147 2023-07-29T17:07:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/147 2023-07-29T17:07:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/147 2023-07-29T17:07:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/147 2023-07-29T17:07:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/147 2023-07-29T17:07:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/147 2023-07-29T17:07:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/147 2023-07-29T17:07:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/147 2023-07-29T17:07:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/147 2023-07-29T17:07:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/147 2023-07-29T17:07:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/147 2023-07-29T17:07:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/147 2023-07-29T17:07:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/147 2023-07-29T17:07:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/147 2023-07-29T17:07:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-07-29T17:07:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-07-29T17:07:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-07-29T17:07:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-07-29T17:07:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-07-29T17:07:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-07-29T17:07:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-07-29T17:07:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-07-29T17:07:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-07-29T17:07:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-07-29T17:07:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-07-29T17:07:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-07-29T17:07:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-07-29T17:07:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-07-29T17:07:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-07-29T17:07:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-07-29T17:07:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-07-29T17:07:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-07-29T17:07:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-07-29T17:07:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 122/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-07-29T17:07:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-07-29T17:07:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:07:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-07-29T17:07:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:07:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-07-29T17:07:46.348 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-07-29T17:07:46.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.349 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.350 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.351 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.352 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.353 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-29T17:07:46.354 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-7.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.355 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.356 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-29T17:07:46.357 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-29T17:07:46.358 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-29T17:07:46.360 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T17:07:46.361 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T17:07:46.362 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T17:07:46.363 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T17:07:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T17:07:46.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:07:46.366 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T17:07:46.367 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T17:07:46.367 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-29T17:07:46.367 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T17:07:46.367 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-29T17:07:46.368 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:07:46.368 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-07-29T17:07:46.593 DEBUG:teuthology.parallel:result is None 2023-07-29T17:08:01.211 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 99/147 2023-07-29T17:08:01.211 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-07-29T17:08:01.211 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-07-29T17:08:01.211 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-07-29T17:08:01.212 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:01.585 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:08:03.165 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 100/147 2023-07-29T17:08:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:08:03.626 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 101/147 2023-07-29T17:08:03.860 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:08:04.314 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 102/147 2023-07-29T17:08:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:08:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 103/147 2023-07-29T17:08:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-07-29T17:08:04.995 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-07-29T17:08:05.134 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:08:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-07-29T17:08:05.496 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-07-29T17:08:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-07-29T17:08:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:08:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 109/147 2023-07-29T17:08:06.548 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 110/147 2023-07-29T17:08:06.757 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 111/147 2023-07-29T17:08:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:08:07.210 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 112/147 2023-07-29T17:08:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:08:08.388 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 113/147 2023-07-29T17:08:08.567 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:08:08.659 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 114/147 2023-07-29T17:08:09.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 115/147 2023-07-29T17:08:09.300 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:08:09.337 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 116/147 2023-07-29T17:08:09.542 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:08:09.553 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 117/147 2023-07-29T17:08:09.781 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 118/147 2023-07-29T17:08:09.950 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:08:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-07-29T17:08:15.861 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 120/147 2023-07-29T17:08:16.083 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:08:16.117 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 121/147 2023-07-29T17:08:16.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:08:16.678 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 122/147 2023-07-29T17:08:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:08:16.983 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 123/147 2023-07-29T17:08:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:08:18.145 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-07-29T17:08:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-07-29T17:08:18.635 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-07-29T17:08:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-07-29T17:08:19.055 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 129/147 2023-07-29T17:08:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 130/147 2023-07-29T17:08:19.517 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 131/147 2023-07-29T17:08:19.745 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-07-29T17:08:19.982 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:08:20.069 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-07-29T17:08:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:08:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-07-29T17:08:20.533 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-07-29T17:08:20.690 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-07-29T17:08:20.690 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:08:20.959 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-07-29T17:08:20.960 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:08:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-07-29T17:08:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:08:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-07-29T17:08:21.656 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-07-29T17:08:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:08:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:08:22.150 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-07-29T17:08:22.151 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:08:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:08:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:08:22.593 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-07-29T17:08:22.593 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:08:22.784 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:08:22.784 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:08:23.026 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-07-29T17:08:23.216 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-07-29T17:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/147 2023-07-29T17:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/147 2023-07-29T17:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/147 2023-07-29T17:08:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/147 2023-07-29T17:08:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/147 2023-07-29T17:08:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/147 2023-07-29T17:08:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/147 2023-07-29T17:08:23.823 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/147 2023-07-29T17:08:23.823 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/147 2023-07-29T17:08:23.823 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-07-29T17:08:23.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-07-29T17:08:23.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-07-29T17:08:23.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-07-29T17:08:23.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-07-29T17:08:23.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-07-29T17:08:23.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-07-29T17:08:23.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-07-29T17:08:23.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-07-29T17:08:23.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-07-29T17:08:23.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-07-29T17:08:23.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-07-29T17:08:23.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 122/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 124/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-07-29T17:08:23.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-07-29T17:08:23.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-07-29T17:08:23.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-07-29T17:08:23.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-07-29T17:08:23.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-07-29T17:08:23.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-07-29T17:08:23.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-07-29T17:08:23.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-07-29T17:08:23.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-07-29T17:08:23.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-07-29T17:08:23.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-07-29T17:08:23.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-07-29T17:08:23.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-07-29T17:08:23.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-07-29T17:08:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-07-29T17:08:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-29T17:08:25.944 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-7.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T17:08:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T17:08:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T17:08:25.950 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-29T17:08:25.951 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T17:08:25.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T17:08:25.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T17:08:25.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T17:08:25.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T17:08:25.954 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T17:08:25.955 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T17:08:25.956 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T17:08:25.957 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-29T17:08:25.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T17:08:25.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T17:08:25.960 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-29T17:08:25.961 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T17:08:25.961 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-29T17:08:25.961 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:25.961 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-07-29T17:08:26.221 DEBUG:teuthology.parallel:result is None 2023-07-29T17:08:26.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:08:26.534 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T17:08:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:18.1.3-11.g0484097b.el8 2023-07-29T17:08:26.565 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T17:08:26.565 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T17:08:26.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:08:26.880 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T17:08:26.910 INFO:teuthology.orchestra.run.smithi092.stdout:18.1.3-11.g0484097b.el8 2023-07-29T17:08:26.910 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T17:08:26.911 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T17:08:26.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:08:27.293 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T17:08:27.322 INFO:teuthology.orchestra.run.smithi093.stdout:18.1.3-11.g0484097b.el8 2023-07-29T17:08:27.323 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T17:08:27.323 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T17:08:27.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T17:08:27.720 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T17:08:27.745 INFO:teuthology.orchestra.run.smithi153.stdout:18.1.3-11.g0484097b.el8 2023-07-29T17:08:27.745 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T17:08:27.745 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T17:08:27.746 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-29T17:08:27.746 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:27.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T17:08:27.783 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:27.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T17:08:27.821 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:27.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T17:08:27.859 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:27.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T17:08:27.890 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-29T17:08:27.891 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:27.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T17:08:27.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T17:08:27.994 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:27.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T17:08:28.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T17:08:28.100 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:28.101 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T17:08:28.134 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T17:08:28.208 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:28.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T17:08:28.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T17:08:28.303 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-29T17:08:28.304 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:28.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T17:08:28.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T17:08:28.405 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:28.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T17:08:28.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T17:08:28.510 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:28.510 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T17:08:28.544 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T17:08:28.618 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:28.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T17:08:28.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T17:08:28.712 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-29T17:08:28.713 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:28.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T17:08:28.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T17:08:28.817 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:28.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T17:08:28.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T17:08:28.919 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:28.919 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T17:08:28.952 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T17:08:29.027 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:29.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T17:08:29.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T17:08:29.123 INFO:teuthology.run_tasks:Running task ceph... 2023-07-29T17:08:29.193 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-29T17:08:29.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-07-29T17:08:29.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-07-29T17:08:29.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2023-07-29T17:08:29.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-07-29T17:08:29.231 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-29T17:08:29.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T17:08:29.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T17:08:29.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T17:08:29.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T17:08:29.303 INFO:tasks.ceph:Creating extra log directories... 2023-07-29T17:08:29.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T17:08:29.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T17:08:29.344 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T17:08:29.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T17:08:29.388 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-29T17:08:29.389 INFO:tasks.ceph:config {'conf': {'client': {'client_oc_max_dirty_age': 1, 'ms_inject_delay_max': 5, 'ms_inject_delay_probability': 1, 'ms_inject_delay_type': 'osd'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-29T17:08:29.389 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'branch': 'reef-release', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health}', 'email': None, 'first_in_suite': False, 'job_id': '7356901', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'client_oc_max_dirty_age': 1, 'ms_inject_delay_max': 5, 'ms_inject_delay_probability': 1, 'ms_inject_delay_type': 'osd'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 3661, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2Bjd/ZGQhyoEuwFQwQQmUSQXzEQbGCtKDDAXPgpBQRl45pawflo3FDuk7rbBP/28IWBpFaNlJ1iap8WJwjKs=', 'smithi092.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiwLGs5m8L0bpDn2lsgJZ/+ay7fE4GJIZ++UhZ7gxzJIntha1mlOWWz42UmN7gSs6905UtUSKrI7DD4zYicen9SH7+5WBmnUXN7A/3/D0OQmzDxCJFt7JcvuRPOTvN3YunJi/sXTbhoEEgCfZWQZYzs81ZgNk1CaVfexDjLosEVQd6yiJ6AKdf9j+VIXwA5nGqmcAN2HXdyYVSwx2lZ9gkXMtYehbe87PotzRxwzIS1HjTz8UmYQ/PW9mFDS2NT9vWyGQPf8swTTfgQQOcR6I1dzwgZpkkEKSdQkeL4IFYOYliBkmnj5fF8AfKVYRRi1UO6ALeaH+nnik8aGKpvrtipkMrfIc+t2PzJyBf8d/0xaq4x1YUygGVhyfwrGPTqBuGqvlemDgds+Ix1T/1VzRiLqJ7lrw4zCR61KxHMw+43k/8U53arklMX0wtzDpw6T1tEdj/bPBW6p+HkV4TH4GOVOEI1YR9HGzWab+XWM4kdYU63IYePObQGcXY8V9B1pE=', 'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIOkKTrnE+MDnQ3zMC3F8KzYp2EEcmantLIhl3bCESBJZ7W/f3DcEJRftdgI1kyN5vk9JkDtyGoxTOuKcoZITg=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORe7mcvQFGKGkEap257O5iQXeqpDvrZiIA9ntANn9yDV9mABFmG8Hamo73KBs9/3eSlYNsq4hye9Bs73yVtEsM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'exec': {'client.0': ['dd if=/dev/zero of=./foo count=100', 'sleep 2', 'truncate --size 0 ./foo']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '61140164d2579c30ffff3970615e0f82e40c6470', 'timestamp': '2023-07-29_14:04:17', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-29T17:08:29.390 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T17:08:29.408 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T17:08:29.418 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T17:08:29.420 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T17:08:29.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T17:08:29.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T17:08:29.479 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T17:08:29.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T17:08:29.513 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:29.513 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T17:08:29.572 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T17:08:29.572 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-07-29T17:08:29.633 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 379266 Links: 1 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-29 17:07:26.815603437 +0000 2023-07-29T17:08:29.634 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-29 17:03:33.981367392 +0000 2023-07-29T17:08:29.635 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-29 17:03:33.981367392 +0000 2023-07-29T17:08:29.635 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-29T17:08:29.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T17:08:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-29T17:08:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-29T17:08:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000268382 s, 1.9 MB/s 2023-07-29T17:08:29.706 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T17:08:29.770 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-07-29T17:08:29.832 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T17:08:29.832 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:29.832 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 374638 Links: 1 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-29 17:07:26.815603437 +0000 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-29 17:03:34.507352755 +0000 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-29 17:03:34.507352755 +0000 2023-07-29T17:08:29.833 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-29T17:08:29.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T17:08:29.903 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-29T17:08:29.903 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-29T17:08:29.903 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000212175 s, 2.4 MB/s 2023-07-29T17:08:29.904 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T17:08:29.967 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-07-29T17:08:30.028 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T17:08:30.028 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 385200 Links: 1 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-29 17:07:26.815603437 +0000 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-29 17:03:35.050337645 +0000 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-29 17:03:35.050337645 +0000 2023-07-29T17:08:30.029 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-29T17:08:30.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T17:08:30.100 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-29T17:08:30.100 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-29T17:08:30.100 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00025655 s, 2.0 MB/s 2023-07-29T17:08:30.101 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T17:08:30.164 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-07-29T17:08:30.225 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T17:08:30.226 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 374702 Links: 1 2023-07-29T17:08:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-29 17:07:26.815603437 +0000 2023-07-29T17:08:30.229 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-29 17:03:35.563323370 +0000 2023-07-29T17:08:30.230 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-29 17:03:35.563323370 +0000 2023-07-29T17:08:30.230 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-29T17:08:30.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T17:08:30.296 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-29T17:08:30.297 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-29T17:08:30.297 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000241147 s, 2.1 MB/s 2023-07-29T17:08:30.298 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T17:08:30.359 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:30.360 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:30.360 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T17:08:30.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T17:08:30.383 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-07-29T17:08:30.445 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T17:08:30.445 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 379234 Links: 1 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-07-29 17:07:28.737112939 +0000 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-07-29 17:03:31.990742405 +0000 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-07-29 17:03:31.990742405 +0000 2023-07-29T17:08:30.446 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-07-29T17:08:30.447 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T17:08:30.518 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-07-29T17:08:30.518 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-07-29T17:08:30.518 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000213203 s, 2.4 MB/s 2023-07-29T17:08:30.519 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T17:08:30.582 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-07-29T17:08:30.645 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T17:08:30.645 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:30.645 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 384239 Links: 1 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-07-29 17:07:28.737112939 +0000 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-07-29 17:03:32.563730632 +0000 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-07-29 17:03:32.563730632 +0000 2023-07-29T17:08:30.646 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-07-29T17:08:30.647 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T17:08:30.715 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-07-29T17:08:30.715 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-07-29T17:08:30.716 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000224581 s, 2.3 MB/s 2023-07-29T17:08:30.717 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T17:08:30.777 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-07-29T17:08:30.836 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 377573 Links: 1 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-07-29 17:07:28.737112939 +0000 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-07-29 17:03:33.087719865 +0000 2023-07-29T17:08:30.837 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-07-29 17:03:33.087719865 +0000 2023-07-29T17:08:30.838 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-07-29T17:08:30.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T17:08:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-07-29T17:08:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-07-29T17:08:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000224022 s, 2.3 MB/s 2023-07-29T17:08:30.906 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T17:08:30.965 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-07-29T17:08:31.024 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T17:08:31.024 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 377724 Links: 1 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-07-29 17:07:28.738112918 +0000 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-07-29 17:03:33.606709202 +0000 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-07-29 17:03:33.606709202 +0000 2023-07-29T17:08:31.025 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-07-29T17:08:31.026 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T17:08:31.090 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-07-29T17:08:31.090 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-07-29T17:08:31.090 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000213635 s, 2.4 MB/s 2023-07-29T17:08:31.091 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T17:08:31.149 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:31.150 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:31.150 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T17:08:31.172 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T17:08:31.172 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-07-29T17:08:31.233 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T17:08:31.233 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:31.233 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 384338 Links: 1 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-07-29 17:08:23.425152752 +0000 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-07-29 17:03:35.513186848 +0000 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-07-29 17:03:35.513186848 +0000 2023-07-29T17:08:31.234 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-07-29T17:08:31.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T17:08:31.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-07-29T17:08:31.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-07-29T17:08:31.302 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000250621 s, 2.0 MB/s 2023-07-29T17:08:31.303 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T17:08:31.364 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-07-29T17:08:31.424 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T17:08:31.424 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:31.424 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 377439 Links: 1 2023-07-29T17:08:31.424 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:31.424 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:31.425 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-07-29 17:08:23.425152752 +0000 2023-07-29T17:08:31.425 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-07-29 17:03:36.036177857 +0000 2023-07-29T17:08:31.425 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-07-29 17:03:36.036177857 +0000 2023-07-29T17:08:31.425 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-07-29T17:08:31.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T17:08:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-07-29T17:08:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-07-29T17:08:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000225058 s, 2.3 MB/s 2023-07-29T17:08:31.493 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T17:08:31.553 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-07-29T17:08:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T17:08:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 377500 Links: 1 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-07-29 17:08:23.425152752 +0000 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-07-29 17:03:36.564168780 +0000 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-07-29 17:03:36.564168780 +0000 2023-07-29T17:08:31.612 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-07-29T17:08:31.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T17:08:31.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-07-29T17:08:31.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-07-29T17:08:31.679 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000222811 s, 2.3 MB/s 2023-07-29T17:08:31.680 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T17:08:31.739 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-07-29T17:08:31.797 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 378775 Links: 1 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-07-29 17:08:23.425152752 +0000 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-07-29 17:03:37.103159514 +0000 2023-07-29T17:08:31.798 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-07-29 17:03:37.103159514 +0000 2023-07-29T17:08:31.799 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-07-29T17:08:31.799 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T17:08:31.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-07-29T17:08:31.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-07-29T17:08:31.863 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000233407 s, 2.2 MB/s 2023-07-29T17:08:31.864 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T17:08:31.923 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:31.924 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-07-29T17:08:31.924 INFO:tasks.ceph:Generating config... 2023-07-29T17:08:31.926 INFO:tasks.ceph:[client] client_oc_max_dirty_age = 1 2023-07-29T17:08:31.926 INFO:tasks.ceph:[client] ms_inject_delay_max = 5 2023-07-29T17:08:31.927 INFO:tasks.ceph:[client] ms_inject_delay_probability = 1 2023-07-29T17:08:31.927 INFO:tasks.ceph:[client] ms_inject_delay_type = osd 2023-07-29T17:08:31.927 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-29T17:08:31.928 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-29T17:08:31.928 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-29T17:08:31.928 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-29T17:08:31.929 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-29T17:08:31.929 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-29T17:08:31.929 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-07-29T17:08:31.929 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-29T17:08:31.930 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-29T17:08:31.930 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-29T17:08:31.930 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-29T17:08:31.931 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-29T17:08:31.931 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-29T17:08:31.931 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-29T17:08:31.931 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-29T17:08:31.932 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-29T17:08:31.932 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-29T17:08:31.932 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-07-29T17:08:31.933 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-29T17:08:31.933 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-07-29T17:08:31.933 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-29T17:08:31.934 INFO:tasks.ceph:Setting up mon.a... 2023-07-29T17:08:31.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-29T17:08:32.001 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2023-07-29T17:08:32.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-29T17:08:32.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T17:08:32.082 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.c', '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]')] 2023-07-29T17:08:32.082 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_oc_max_dirty_age': 1, 'ms_inject_delay_max': 5, 'ms_inject_delay_probability': 1, 'ms_inject_delay_type': 'osd'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2023-07-29T17:08:32.083 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:32.083 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T17:08:32.139 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv b '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --addv c '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:32.229 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:32.230 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.230 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-07-29T17:08:32.230 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2023-07-29T17:08:32.230 INFO:teuthology.orchestra.run.smithi073.stdout:fsid a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.231 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2023-07-29T17:08:32.218988+0000 2023-07-29T17:08:32.231 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-07-29T17:08:32.218988+0000 2023-07-29T17:08:32.231 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2023-07-29T17:08:32.232 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2023-07-29T17:08:32.232 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2023-07-29T17:08:32.232 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.b 2023-07-29T17:08:32.232 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] mon.c 2023-07-29T17:08:32.233 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-29T17:08:32.234 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T17:08:32.252 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a332a6fa-930f-490b-a8e4-4300ea7abc2a... 2023-07-29T17:08:32.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T17:08:32.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T17:08:32.298 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T17:08:32.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T17:08:32.337 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-07-29T17:08:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-07-29T17:08:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-07-29T17:08:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-07-29T17:08:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T17:08:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-07-29T17:08:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-07-29T17:08:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-07-29T17:08:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = lz4 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-07-29T17:08:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-07-29T17:08:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-29T17:08:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.350 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-07-29T17:08:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T17:08:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T17:08:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: client_oc_max_dirty_age = 1 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: ms_inject_delay_max = 5 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: ms_inject_delay_probability = 1 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: ms_inject_delay_type = osd 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-07-29T17:08:32.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-07-29T17:08:32.356 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-07-29T17:08:32.356 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-07-29T17:08:32.357 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T17:08:32.358 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-07-29T17:08:32.359 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T17:08:32.360 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-07-29T17:08:32.361 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-07-29T17:08:32.362 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-07-29T17:08:32.363 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.364 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-07-29T17:08:32.365 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore compression algorithm = lz4 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore compression mode = aggressive 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 1/20 2023-07-29T17:08:32.366 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 1/20 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 4/10 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: osd blocked scrub grace period = 3600 2023-07-29T17:08:32.367 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: osd max markdown count = 1000 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-07-29T17:08:32.368 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-07-29T17:08:32.369 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-07-29T17:08:32.370 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T17:08:32.371 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-29T17:08:32.372 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: client_oc_max_dirty_age = 1 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: ms_inject_delay_max = 5 2023-07-29T17:08:32.373 INFO:teuthology.orchestra.run.smithi093.stdout: ms_inject_delay_probability = 1 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi093.stdout: ms_inject_delay_type = osd 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-07-29T17:08:32.374 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.375 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T17:08:32.376 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-07-29T17:08:32.377 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T17:08:32.378 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.379 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-07-29T17:08:32.380 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-07-29T17:08:32.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.382 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.383 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore compression algorithm = lz4 2023-07-29T17:08:32.384 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore compression mode = aggressive 2023-07-29T17:08:32.385 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-07-29T17:08:32.385 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2023-07-29T17:08:32.385 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2023-07-29T17:08:32.385 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-29T17:08:32.385 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: osd blocked scrub grace period = 3600 2023-07-29T17:08:32.386 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout: osd max markdown count = 1000 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-29T17:08:32.387 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-07-29T17:08:32.388 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.389 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.390 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T17:08:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T17:08:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T17:08:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-07-29T17:08:32.391 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-07-29T17:08:32.392 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-07-29T17:08:32.393 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout: client_oc_max_dirty_age = 1 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout: ms_inject_delay_max = 5 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout: ms_inject_delay_probability = 1 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout: ms_inject_delay_type = osd 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-07-29T17:08:32.394 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-07-29T17:08:32.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-07-29T17:08:32.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T17:08:32.397 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-07-29T17:08:32.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-07-29T17:08:32.399 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-07-29T17:08:32.400 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.401 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-07-29T17:08:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.404 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression algorithm = lz4 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression mode = aggressive 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-07-29T17:08:32.405 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-07-29T17:08:32.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-07-29T17:08:32.407 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-07-29T17:08:32.408 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-07-29T17:08:32.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T17:08:32.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-07-29T17:08:32.411 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: client_oc_max_dirty_age = 1 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: ms_inject_delay_max = 5 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: ms_inject_delay_probability = 1 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout: ms_inject_delay_type = osd 2023-07-29T17:08:32.412 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-07-29T17:08:32.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-07-29T17:08:32.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-07-29T17:08:32.413 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-07-29T17:08:32.415 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-29T17:08:32.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-29T17:08:32.512 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-29T17:08:32.512 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:32.512 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-29T17:08:32.530 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:32.530 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-29T17:08:32.588 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T17:08:32.588 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:32.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T17:08:32.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T17:08:32.665 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:32.665 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:32.722 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-07-29T17:08:32.723 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:32.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T17:08:32.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T17:08:32.767 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:32.768 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:32.829 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:08:32.829 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:32.830 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T17:08:32.830 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T17:08:32.875 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:32.876 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:32.937 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-07-29T17:08:32.938 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:32.938 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T17:08:32.938 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T17:08:32.977 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:32.977 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:33.035 INFO:tasks.ceph:Setting up mon nodes... 2023-07-29T17:08:33.036 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-29T17:08:33.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T17:08:33.092 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T17:08:33.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T17:08:33.148 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T17:08:33.150 INFO:tasks.ceph:Setting up mds nodes... 2023-07-29T17:08:33.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T17:08:33.205 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T17:08:33.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-29T17:08:33.234 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-29T17:08:33.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-29T17:08:33.318 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-29T17:08:33.330 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-29T17:08:33.330 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-07-29T17:08:33.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-29T17:08:33.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:33.363 INFO:tasks.ceph:role: osd.0 2023-07-29T17:08:33.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-29T17:08:33.364 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T17:08:33.443 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T17:08:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T17:08:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T17:08:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T17:08:33.445 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T17:08:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-07-29T17:08:33.446 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T17:08:33.446 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T17:08:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T17:08:33.446 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T17:08:33.874 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-07-29T17:08:33.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-07-29T17:08:33.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-29T17:08:34.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-29T17:08:34.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:34.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.209+0000 7f676f340640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-29T17:08:34.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.214+0000 7f676f340640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-29T17:08:34.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.214+0000 7f676f340640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T17:08:34.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.214+0000 7f676f340640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T17:08:34.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.214+0000 7f676f340640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T17:08:34.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-29T17:08:34.221+0000 7f676f340640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-29T17:08:37.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-29T17:08:37.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-29T17:08:37.145 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:37.146 INFO:tasks.ceph:role: osd.1 2023-07-29T17:08:37.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:08:37.146 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T17:08:37.223 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-07-29T17:08:37.224 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T17:08:37.225 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T17:08:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T17:08:37.225 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T17:08:37.661 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-07-29T17:08:37.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-07-29T17:08:37.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-07-29T17:08:37.837 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-29T17:08:37.880 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:37.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.974+0000 7f079bbec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-29T17:08:37.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.975+0000 7f079bbec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-29T17:08:37.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.975+0000 7f079bbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T17:08:37.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.975+0000 7f079bbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T17:08:37.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.975+0000 7f079bbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T17:08:37.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-07-29T17:08:37.982+0000 7f079bbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-29T17:08:40.846 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-29T17:08:40.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-29T17:08:40.913 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-07-29T17:08:40.914 INFO:tasks.ceph:role: osd.2 2023-07-29T17:08:40.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2023-07-29T17:08:40.915 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T17:08:40.992 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T17:08:40.992 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T17:08:40.992 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T17:08:40.992 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T17:08:40.992 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T17:08:40.993 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-07-29T17:08:40.993 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T17:08:40.993 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T17:08:40.993 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T17:08:40.993 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T17:08:41.428 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-07-29T17:08:41.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-07-29T17:08:41.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-07-29T17:08:41.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-29T17:08:41.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:41.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.894+0000 7fe9d8eed640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-29T17:08:41.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.894+0000 7fe9d8eed640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-29T17:08:41.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.894+0000 7fe9d8eed640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T17:08:41.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.894+0000 7fe9d8eed640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T17:08:41.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.894+0000 7fe9d8eed640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T17:08:41.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-07-29T17:08:41.895+0000 7fe9d8eed640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-29T17:08:44.758 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-29T17:08:44.792 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-29T17:08:44.793 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:44.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-29T17:08:44.826 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:44.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-29T17:08:44.897 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:44.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-29T17:08:44.967 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:44.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-29T17:08:45.001 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:45.002 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-29T17:08:45.034 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:45.034 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-29T17:08:45.066 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:08:45.067 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-29T17:08:45.087 INFO:tasks.ceph:Adding keys to all mons... 2023-07-29T17:08:45.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-29T17:08:45.156 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-07-29T17:08:45.156 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCRR8VkyWbdBBAA8cOpxjIVkROtPlV8tShEBw== 2023-07-29T17:08:45.156 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-07-29T17:08:45.156 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCRR8VkVpA1CBAAXrO0OwKb4io6ksGJJBv64w== 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCRR8Vkj/OZCxAAwnNk4J42sMIvZLCf4EE2sg== 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCSR8Vk7w+dDBAAgmgtnUtADt9J8ZX3SimK3w== 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCVR8VkZvclOhAAc4Qqh8eoGOEimT2FOcHNBQ== 2023-07-29T17:08:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-07-29T17:08:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCZR8Vk6MNjNRAA46GHaj/x4IhXeDkSRr7VQA== 2023-07-29T17:08:45.158 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-07-29T17:08:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCRR8VkX4VTEhAAk2yqql61EjXRrGyjsx+A0w== 2023-07-29T17:08:45.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T17:08:45.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T17:08:45.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T17:08:45.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T17:08:45.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T17:08:45.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T17:08:45.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-29T17:08:45.585 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-29T17:08:45.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-29T17:08:45.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T17:08:45.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-29T17:08:45.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-29T17:08:45.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T17:08:45.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-29T17:08:45.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-29T17:08:46.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T17:08:46.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-29T17:08:46.139 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:08:46.196 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-29T17:08:46.197 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-29T17:08:46.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-29T17:08:46.239 INFO:tasks.ceph.mon.a:Started 2023-07-29T17:08:46.239 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-29T17:08:46.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-29T17:08:46.241 INFO:tasks.ceph.mon.b:Started 2023-07-29T17:08:46.241 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-29T17:08:46.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-29T17:08:46.243 INFO:tasks.ceph.mon.c:Started 2023-07-29T17:08:46.243 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-29T17:08:46.244 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-29T17:08:46.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-29T17:08:46.246 INFO:tasks.ceph.mgr.x:Started 2023-07-29T17:08:46.246 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-29T17:08:46.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-29T17:08:46.248 INFO:tasks.ceph.mgr.y:Started 2023-07-29T17:08:46.248 INFO:tasks.ceph:Setting crush tunables to default 2023-07-29T17:08:46.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2023-07-29T17:08:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-07-29T17:08:46.707 INFO:tasks.ceph:check_enable_crimson: False 2023-07-29T17:08:46.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-29T17:08:46.708 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-29T17:08:46.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-29T17:08:46.741 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-07-29T17:08:46.741 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-29T17:08:46.742 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:46.730+0000 7fd3902c4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T17:08:46.742 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:46.730+0000 7fb4e43a4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T17:08:46.776 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-07-29T17:08:46.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-29T17:08:46.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9 0 2023-07-29T17:08:46.917 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:46.905+0000 7fb4e43a4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T17:08:46.918 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:46.907+0000 7fd3902c4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T17:08:47.067 INFO:teuthology.orchestra.run.smithi153.stdout:0 2023-07-29T17:08:47.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new ee52c2b3-837b-4ab3-8826-4fae9cff4ee7 1 2023-07-29T17:08:47.290 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-07-29T17:08:47.302 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 940667e0-3fe5-459e-8934-96e6b34a39ec 2 2023-07-29T17:08:47.311 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:47.299+0000 7fb4e43a4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T17:08:47.311 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:47.300+0000 7fd3902c4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T17:08:47.517 INFO:teuthology.orchestra.run.smithi153.stdout:2 2023-07-29T17:08:47.529 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-29T17:08:47.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-29T17:08:47.532 INFO:tasks.ceph.osd.0:Started 2023-07-29T17:08:47.533 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-29T17:08:47.533 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-29T17:08:47.535 INFO:tasks.ceph.osd.1:Started 2023-07-29T17:08:47.536 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-29T17:08:47.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-29T17:08:47.538 INFO:tasks.ceph.osd.2:Started 2023-07-29T17:08:47.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:08:47.774 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:08:47.774 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:08:47.499348+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:08:47.787 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-29T17:08:47.787 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-29T17:08:47.853 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:47.842+0000 7fd3902c4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T17:08:47.854 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:47.842+0000 7fb4e43a4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T17:08:48.066 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:48.054+0000 7fb4e43a4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T17:08:48.067 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:48.055+0000 7fd3902c4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T17:08:48.089 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T17:08:48.129 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:08:48.116+0000 7f5255908640 -1 Falling back to public interface 2023-07-29T17:08:48.138 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:08:48.125+0000 7f18814b0640 -1 Falling back to public interface 2023-07-29T17:08:48.139 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:08:48.128+0000 7f354e8f8640 -1 Falling back to public interface 2023-07-29T17:08:48.290 INFO:teuthology.misc.health.smithi073.stdout: 2023-07-29T17:08:48.290 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":5,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:08:47.499348+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:08:48.306 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-29T17:08:48.468 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:48.456+0000 7fd3902c4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T17:08:48.468 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:48.456+0000 7fb4e43a4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T17:08:49.171 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.159+0000 7fd3902c4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T17:08:49.171 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.159+0000 7fb4e43a4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T17:08:49.247 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.235+0000 7fd3902c4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T17:08:49.248 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.235+0000 7fb4e43a4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T17:08:49.389 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.377+0000 7fb4e43a4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T17:08:49.389 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.377+0000 7fd3902c4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T17:08:49.463 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.451+0000 7fd3902c4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T17:08:49.463 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.451+0000 7fb4e43a4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T17:08:49.655 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.643+0000 7fd3902c4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T17:08:49.656 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.644+0000 7fb4e43a4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T17:08:49.738 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.726+0000 7fd3902c4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T17:08:49.739 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.727+0000 7fb4e43a4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T17:08:49.820 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.808+0000 7fd3902c4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T17:08:49.821 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.808+0000 7fb4e43a4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T17:08:49.920 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:49.908+0000 7fb4e43a4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T17:08:49.920 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:49.908+0000 7fd3902c4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T17:08:50.121 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:50.109+0000 7fd3902c4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T17:08:50.122 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:50.110+0000 7fb4e43a4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T17:08:50.206 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:50.195+0000 7fd3902c4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T17:08:50.207 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:50.195+0000 7fb4e43a4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T17:08:50.514 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:50.502+0000 7fd3902c4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T17:08:50.515 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:50.503+0000 7fb4e43a4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T17:08:50.589 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:50.578+0000 7fd3902c4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T17:08:50.590 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:50.578+0000 7fb4e43a4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T17:08:51.120 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:51.108+0000 7fd3902c4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T17:08:51.121 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:51.108+0000 7fb4e43a4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T17:08:51.457 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:51.445+0000 7fd3902c4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T17:08:51.458 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:51.445+0000 7fb4e43a4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T17:08:51.564 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:08:51.551+0000 7f18814b0640 -1 osd.1 0 log_to_monitors true 2023-07-29T17:08:51.567 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:08:51.556+0000 7f5255908640 -1 osd.2 0 log_to_monitors true 2023-07-29T17:08:51.570 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:08:51.559+0000 7f354e8f8640 -1 osd.0 0 log_to_monitors true 2023-07-29T17:08:51.608 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:51.596+0000 7fd3902c4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T17:08:51.609 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:51.597+0000 7fb4e43a4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T17:08:51.984 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:51.972+0000 7fb4e43a4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T17:08:51.985 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:51.972+0000 7fd3902c4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T17:08:52.137 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:52.125+0000 7fd3902c4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T17:08:52.137 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:52.125+0000 7fb4e43a4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T17:08:52.296 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:52.284+0000 7fb4e43a4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T17:08:52.297 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:52.284+0000 7fd3902c4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T17:08:52.628 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-07-29T17:08:52.616+0000 7fd3902c4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T17:08:52.629 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:52.617+0000 7fb4e43a4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T17:08:53.647 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:53.635+0000 7fb4a57bf700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-29T17:08:53.648 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:08:53.635+0000 7fb4a57bf700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-29T17:08:54.061 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:08:54.048+0000 7f1875851700 -1 osd.1 0 waiting for initial osdmap 2023-07-29T17:08:54.069 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:08:54.058+0000 7f5249ca9700 -1 osd.2 0 waiting for initial osdmap 2023-07-29T17:08:54.071 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:08:54.060+0000 7f186d42b700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T17:08:54.079 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:08:54.068+0000 7f5241883700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T17:08:54.081 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:08:54.069+0000 7f3542c99700 -1 osd.0 0 waiting for initial osdmap 2023-07-29T17:08:54.095 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:08:54.083+0000 7f353a873700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T17:08:54.611 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T17:08:54.931 INFO:teuthology.misc.health.smithi073.stdout: 2023-07-29T17:08:54.932 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":7,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:08:53.339004+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:08:54.944 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-29T17:09:01.248 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:01.571 INFO:teuthology.misc.health.smithi073.stdout: 2023-07-29T17:09:01.572 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":12,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:08:59.367608+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:01.584 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-07-29T17:09:01.584 INFO:tasks.ceph:Creating RBD pool 2023-07-29T17:09:01.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-29T17:09:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2023-07-29T17:09:02.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-29T17:09:03.405 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-29T17:09:03.418 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-29T17:09:03.418 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-29T17:09:03.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-29T17:09:03.421 INFO:tasks.ceph.mds.a:Started 2023-07-29T17:09:03.421 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-29T17:09:03.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:03.504 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-07-29T17:09:03.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:03.755 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:03.380551+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:03.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:03.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:04.085 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:04.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:04.421 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:04.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T17:09:04.793 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:04.793 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6803/3518997653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3518997653},{"type":"v1","addr":"172.21.15.73:6803","nonce":3518997653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-29T17:09:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2023-07-29T17:09:04.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:05.124 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:05.124 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:04.384824+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:05.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:05.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:05.456 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:05.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:05.786 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:05.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-29T17:09:06.115 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:06.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:06.117 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 2, 2023-07-29T17:09:06.117 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2023-07-29T17:09:06.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:06.117 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-07-29T17:09:06.129 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-29T17:09:06.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-29T17:09:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-07-29T17:09:07.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-29T17:09:08.424 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-07-29T17:09:08.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-29T17:09:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 3 and data pool 4 2023-07-29T17:09:08.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:09.143 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:08.789241+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:09.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:09.474 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:09.475 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:08.789241+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:09.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-29T17:09:10.838 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-29T17:09:10.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-29T17:09:11.838 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-29T17:09:11.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T17:09:12.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:12.196 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T17:09:08.789543+0000","modified":"2023-07-29T17:09:11.804074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3518997653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3518997653},{"type":"v1","addr":"172.21.15.73:6803","nonce":3518997653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T17:09:12.198 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2023-07-29T17:09:12.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:12.529 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:12.530 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:12.543 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-29T17:09:12.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:12.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:12.876 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:12.884 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-29T17:09:12.629727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.225386"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800407+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:09.800407+0000","last_peered":"2023-07-29T17:09:09.800407+0000","last_clean":"2023-07-29T17:09:09.800407+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:09.800407+0000","last_undegraded":"2023-07-29T17:09:09.800407+0000","last_fullsized":"2023-07-29T17:09:09.800407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:12.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:13.245 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:13.256 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-29T17:09:12.629727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.225386"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800407+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:09.800407+0000","last_peered":"2023-07-29T17:09:09.800407+0000","last_clean":"2023-07-29T17:09:09.800407+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:09.800407+0000","last_undegraded":"2023-07-29T17:09:09.800407+0000","last_fullsized":"2023-07-29T17:09:09.800407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:13.266 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-29T17:09:13.267 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-29T17:09:13.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-29T17:09:13.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-29T17:09:13.268 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-29T17:09:13.526 INFO:tasks.ceph.mds.a.smithi073.stderr:2023-07-29T17:09:13.514+0000 7fb733b2f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T17:09:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:13.684 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":109769},{"type":"v1","addr":"172.21.15.73:6801","nonce":109769}]},"active_addr":"172.21.15.73:6801/109769","active_change":"2023-07-29T17:08:52.620022+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1416914728}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":738089787}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2166814555}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":493460858}]}]} 2023-07-29T17:09:13.690 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-29T17:09:13.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-29T17:09:13.690 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:14.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:14.006 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:14.020 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-29T17:09:14.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:14.338 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:14.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-29T17:09:14.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-29T17:09:14.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-29T17:09:18.424 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2023-07-29T17:09:18.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T17:09:18.434 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2023-07-29T17:09:18.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T17:09:18.435 INFO:teuthology.orchestra.run.smithi073.stdout:34359738373 2023-07-29T17:09:18.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T17:09:18.773 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2023-07-29T17:09:18.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.2 2023-07-29T17:09:18.788 DEBUG:teuthology.parallel:result is None 2023-07-29T17:09:18.812 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2023-07-29T17:09:18.818 INFO:teuthology.orchestra.run.smithi073.stdout:34359738375 2023-07-29T17:09:18.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.1 2023-07-29T17:09:18.827 DEBUG:teuthology.parallel:result is None 2023-07-29T17:09:18.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.0 2023-07-29T17:09:18.833 DEBUG:teuthology.parallel:result is None 2023-07-29T17:09:18.833 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T17:09:18.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:19.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:19.206 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-29T17:09:18.631087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.836539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634367+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:10.634367+0000","last_peered":"2023-07-29T17:09:10.634367+0000","last_clean":"2023-07-29T17:09:10.634367+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:10.634367+0000","last_undegraded":"2023-07-29T17:09:10.634367+0000","last_fullsized":"2023-07-29T17:09:10.634367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:19.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:19.583 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-29T17:09:18.631087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.836539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634367+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:10.634367+0000","last_peered":"2023-07-29T17:09:10.634367+0000","last_clean":"2023-07-29T17:09:10.634367+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:10.634367+0000","last_undegraded":"2023-07-29T17:09:10.634367+0000","last_fullsized":"2023-07-29T17:09:10.634367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:19.589 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T17:09:19.589 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-29T17:09:19.589 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-29T17:09:19.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-29T17:09:19.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:19.977 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-29T17:09:19.991 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-29T17:09:19.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:20.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:20.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:20.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T17:09:06.456697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T17:09:07.770105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:20.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:20.641 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:20.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:20.970 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:20.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T17:09:21.299 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-07-29T17:09:21.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T17:09:21.633 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-07-29T17:09:21.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T17:09:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:22.002 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T17:09:08.789543+0000","modified":"2023-07-29T17:09:11.804074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3518997653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3518997653},{"type":"v1","addr":"172.21.15.73:6803","nonce":3518997653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T17:09:22.004 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2023-07-29T17:09:22.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:22.332 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:22.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T17:09:06.456697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T17:09:07.770105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:22.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:22.661 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:22.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:22.993 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:23.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T17:09:23.324 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-07-29T17:09:23.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T17:09:23.658 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-07-29T17:09:23.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T17:09:24.027 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:24.027 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T17:09:08.789543+0000","modified":"2023-07-29T17:09:11.804074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3518997653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3518997653},{"type":"v1","addr":"172.21.15.73:6803","nonce":3518997653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T17:09:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2023-07-29T17:09:24.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:24.356 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:09.793498+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:24.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T17:09:24.731 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:24.732 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T17:09:08.789543+0000","modified":"2023-07-29T17:09:11.804074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3518997653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3518997653},{"type":"v1","addr":"172.21.15.73:6803","nonce":3518997653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T17:09:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2023-07-29T17:09:24.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-29T17:09:08.789543+0000', 'modified': '2023-07-29T17:09:11.804074+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4207': {'gid': 4207, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6803/3518997653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 3518997653}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 3518997653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-29T17:09:24.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-29T17:09:24.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-29T17:09:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-29T17:09:24.967+0000 7f35c97fa700 0 client.4448 ms_handle_reset on v2:172.21.15.73:6802/3518997653 2023-07-29T17:09:25.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-07-29T17:09:24.989+0000 7f35c97fa700 0 client.4474 ms_handle_reset on v2:172.21.15.73:6802/3518997653 2023-07-29T17:09:25.002 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-07-29T17:09:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a332a6fa-930f-490b-a8e4-4300ea7abc2a", 2023-07-29T17:09:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-07-29T17:09:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4207, 2023-07-29T17:09:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 16.195616328, 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 6, 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 19, 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 19, 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 21.495899528999999 2023-07-29T17:09:25.003 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-07-29T17:09:25.014 INFO:teuthology.run_tasks:Running task thrashosds... 2023-07-29T17:09:25.029 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-07-29T17:09:25.030 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'client_oc_max_dirty_age': 1, 'ms_inject_delay_max': 5, 'ms_inject_delay_probability': 1, 'ms_inject_delay_type': 'osd'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}} 2023-07-29T17:09:25.030 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-07-29T17:09:25.030 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-07-29T17:09:25.030 DEBUG:teuthology.orchestra.run.smithi073:> sync 2023-07-29T17:09:25.216 DEBUG:teuthology.orchestra.run.smithi092:> sync 2023-07-29T17:09:25.359 DEBUG:teuthology.orchestra.run.smithi093:> sync 2023-07-29T17:09:25.431 DEBUG:teuthology.orchestra.run.smithi153:> sync 2023-07-29T17:09:25.599 DEBUG:tasks.thrashosds:checking console status of smithi073 2023-07-29T17:09:25.600 DEBUG:teuthology.orchestra.console.smithi073:Waiting for login prompt 2023-07-29T17:09:25.600 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi073 2023-07-29T17:09:25.746 DEBUG:teuthology.orchestra.console.smithi073:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T17:09:25.747 DEBUG:teuthology.orchestra.console.smithi073:expect after: smithi073 login: 2023-07-29T17:09:25.800 DEBUG:teuthology.orchestra.console.smithi073:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi073 login: [disconnect] 2023-07-29T17:09:25.902 DEBUG:tasks.thrashosds:checking console status of smithi092 2023-07-29T17:09:25.902 DEBUG:teuthology.orchestra.console.smithi092:Waiting for login prompt 2023-07-29T17:09:25.903 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi092 2023-07-29T17:09:26.033 DEBUG:teuthology.orchestra.console.smithi092:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T17:09:26.034 DEBUG:teuthology.orchestra.console.smithi092:expect after: smithi092 login: 2023-07-29T17:09:26.087 DEBUG:teuthology.orchestra.console.smithi092:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi092 login: [disconnect] 2023-07-29T17:09:26.188 DEBUG:tasks.thrashosds:checking console status of smithi093 2023-07-29T17:09:26.189 DEBUG:teuthology.orchestra.console.smithi093:Waiting for login prompt 2023-07-29T17:09:26.189 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi093 2023-07-29T17:09:26.345 DEBUG:teuthology.orchestra.console.smithi093:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T17:09:26.346 DEBUG:teuthology.orchestra.console.smithi093:expect after: smithi093 login: 2023-07-29T17:09:26.398 DEBUG:teuthology.orchestra.console.smithi093:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi093 login: [disconnect] 2023-07-29T17:09:26.500 DEBUG:tasks.thrashosds:checking console status of smithi153 2023-07-29T17:09:26.500 DEBUG:teuthology.orchestra.console.smithi153:Waiting for login prompt 2023-07-29T17:09:26.500 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi153 2023-07-29T17:09:26.680 DEBUG:teuthology.orchestra.console.smithi153:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T17:09:26.681 DEBUG:teuthology.orchestra.console.smithi153:expect after: smithi153 login: 2023-07-29T17:09:26.734 DEBUG:teuthology.orchestra.console.smithi153:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi153 login: [disconnect] 2023-07-29T17:09:26.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-07-29T17:09:27.185 INFO:tasks.thrashosds:Beginning thrashosds... 2023-07-29T17:09:27.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T17:09:27.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:27.507 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:27.517 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-29T17:09:26.632534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002308"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634367+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:10.634367+0000","last_peered":"2023-07-29T17:09:10.634367+0000","last_clean":"2023-07-29T17:09:10.634367+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:10.634367+0000","last_undegraded":"2023-07-29T17:09:10.634367+0000","last_fullsized":"2023-07-29T17:09:10.634367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:27.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:27.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:27.882 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:27.893 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-29T17:09:26.632534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81512,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034008,"statfs":{"total":289910292480,"available":289826824192,"internally_reserved":0,"allocated":671744,"data_stored":1358551,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002308"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803295+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:09.803295+0000","last_peered":"2023-07-29T17:09:09.803295+0000","last_clean":"2023-07-29T17:09:09.803295+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:09.803295+0000","last_undegraded":"2023-07-29T17:09:09.803295+0000","last_fullsized":"2023-07-29T17:09:09.803295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802804+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:09.802804+0000","last_peered":"2023-07-29T17:09:09.802804+0000","last_clean":"2023-07-29T17:09:09.802804+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:09.802804+0000","last_undegraded":"2023-07-29T17:09:09.802804+0000","last_fullsized":"2023-07-29T17:09:09.802804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803259+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:09.803259+0000","last_peered":"2023-07-29T17:09:09.803259+0000","last_clean":"2023-07-29T17:09:09.803259+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:09.803259+0000","last_undegraded":"2023-07-29T17:09:09.803259+0000","last_fullsized":"2023-07-29T17:09:09.803259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803114+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:09.803114+0000","last_peered":"2023-07-29T17:09:09.803114+0000","last_clean":"2023-07-29T17:09:09.803114+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:09.803114+0000","last_undegraded":"2023-07-29T17:09:09.803114+0000","last_fullsized":"2023-07-29T17:09:09.803114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802556+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:09.802556+0000","last_peered":"2023-07-29T17:09:09.802556+0000","last_clean":"2023-07-29T17:09:09.802556+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:09.802556+0000","last_undegraded":"2023-07-29T17:09:09.802556+0000","last_fullsized":"2023-07-29T17:09:09.802556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802513+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:09.802513+0000","last_peered":"2023-07-29T17:09:09.802513+0000","last_clean":"2023-07-29T17:09:09.802513+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:09.802513+0000","last_undegraded":"2023-07-29T17:09:09.802513+0000","last_fullsized":"2023-07-29T17:09:09.802513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802555+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:09.802555+0000","last_peered":"2023-07-29T17:09:09.802555+0000","last_clean":"2023-07-29T17:09:09.802555+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:09.802555+0000","last_undegraded":"2023-07-29T17:09:09.802555+0000","last_fullsized":"2023-07-29T17:09:09.802555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802096+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:09.802096+0000","last_peered":"2023-07-29T17:09:09.802096+0000","last_clean":"2023-07-29T17:09:09.802096+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:09.802096+0000","last_undegraded":"2023-07-29T17:09:09.802096+0000","last_fullsized":"2023-07-29T17:09:09.802096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800181+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:09.800181+0000","last_peered":"2023-07-29T17:09:09.800181+0000","last_clean":"2023-07-29T17:09:09.800181+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:09.800181+0000","last_undegraded":"2023-07-29T17:09:09.800181+0000","last_fullsized":"2023-07-29T17:09:09.800181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803078+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:09.803078+0000","last_peered":"2023-07-29T17:09:09.803078+0000","last_clean":"2023-07-29T17:09:09.803078+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:09.803078+0000","last_undegraded":"2023-07-29T17:09:09.803078+0000","last_fullsized":"2023-07-29T17:09:09.803078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802786+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:09.802786+0000","last_peered":"2023-07-29T17:09:09.802786+0000","last_clean":"2023-07-29T17:09:09.802786+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:09.802786+0000","last_undegraded":"2023-07-29T17:09:09.802786+0000","last_fullsized":"2023-07-29T17:09:09.802786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802473+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:09.802473+0000","last_peered":"2023-07-29T17:09:09.802473+0000","last_clean":"2023-07-29T17:09:09.802473+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:09.802473+0000","last_undegraded":"2023-07-29T17:09:09.802473+0000","last_fullsized":"2023-07-29T17:09:09.802473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802335+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:09.802335+0000","last_peered":"2023-07-29T17:09:09.802335+0000","last_clean":"2023-07-29T17:09:09.802335+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:09.802335+0000","last_undegraded":"2023-07-29T17:09:09.802335+0000","last_fullsized":"2023-07-29T17:09:09.802335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803149+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:09.803149+0000","last_peered":"2023-07-29T17:09:09.803149+0000","last_clean":"2023-07-29T17:09:09.803149+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:09.803149+0000","last_undegraded":"2023-07-29T17:09:09.803149+0000","last_fullsized":"2023-07-29T17:09:09.803149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802303+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:09.802303+0000","last_peered":"2023-07-29T17:09:09.802303+0000","last_clean":"2023-07-29T17:09:09.802303+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:09.802303+0000","last_undegraded":"2023-07-29T17:09:09.802303+0000","last_fullsized":"2023-07-29T17:09:09.802303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802094+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:09.802094+0000","last_peered":"2023-07-29T17:09:09.802094+0000","last_clean":"2023-07-29T17:09:09.802094+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:09.802094+0000","last_undegraded":"2023-07-29T17:09:09.802094+0000","last_fullsized":"2023-07-29T17:09:09.802094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800259+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:09.800259+0000","last_peered":"2023-07-29T17:09:09.800259+0000","last_clean":"2023-07-29T17:09:09.800259+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:09.800259+0000","last_undegraded":"2023-07-29T17:09:09.800259+0000","last_fullsized":"2023-07-29T17:09:09.800259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803120+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:09.803120+0000","last_peered":"2023-07-29T17:09:09.803120+0000","last_clean":"2023-07-29T17:09:09.803120+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:09.803120+0000","last_undegraded":"2023-07-29T17:09:09.803120+0000","last_fullsized":"2023-07-29T17:09:09.803120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800068+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:09.800068+0000","last_peered":"2023-07-29T17:09:09.800068+0000","last_clean":"2023-07-29T17:09:09.800068+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:09.800068+0000","last_undegraded":"2023-07-29T17:09:09.800068+0000","last_fullsized":"2023-07-29T17:09:09.800068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803066+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:09.803066+0000","last_peered":"2023-07-29T17:09:09.803066+0000","last_clean":"2023-07-29T17:09:09.803066+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:09.803066+0000","last_undegraded":"2023-07-29T17:09:09.803066+0000","last_fullsized":"2023-07-29T17:09:09.803066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802732+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:09.802732+0000","last_peered":"2023-07-29T17:09:09.802732+0000","last_clean":"2023-07-29T17:09:09.802732+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:09.802732+0000","last_undegraded":"2023-07-29T17:09:09.802732+0000","last_fullsized":"2023-07-29T17:09:09.802732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802239+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:09.802239+0000","last_peered":"2023-07-29T17:09:09.802239+0000","last_clean":"2023-07-29T17:09:09.802239+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:09.802239+0000","last_undegraded":"2023-07-29T17:09:09.802239+0000","last_fullsized":"2023-07-29T17:09:09.802239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799652+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:09.799652+0000","last_peered":"2023-07-29T17:09:09.799652+0000","last_clean":"2023-07-29T17:09:09.799652+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:09.799652+0000","last_undegraded":"2023-07-29T17:09:09.799652+0000","last_fullsized":"2023-07-29T17:09:09.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802621+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:09.802621+0000","last_peered":"2023-07-29T17:09:09.802621+0000","last_clean":"2023-07-29T17:09:09.802621+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:09.802621+0000","last_undegraded":"2023-07-29T17:09:09.802621+0000","last_fullsized":"2023-07-29T17:09:09.802621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803183+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:09.803183+0000","last_peered":"2023-07-29T17:09:09.803183+0000","last_clean":"2023-07-29T17:09:09.803183+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:09.803183+0000","last_undegraded":"2023-07-29T17:09:09.803183+0000","last_fullsized":"2023-07-29T17:09:09.803183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800518+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:09.800518+0000","last_peered":"2023-07-29T17:09:09.800518+0000","last_clean":"2023-07-29T17:09:09.800518+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:09.800518+0000","last_undegraded":"2023-07-29T17:09:09.800518+0000","last_fullsized":"2023-07-29T17:09:09.800518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803188+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:09.803188+0000","last_peered":"2023-07-29T17:09:09.803188+0000","last_clean":"2023-07-29T17:09:09.803188+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:09.803188+0000","last_undegraded":"2023-07-29T17:09:09.803188+0000","last_fullsized":"2023-07-29T17:09:09.803188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802289+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:09.802289+0000","last_peered":"2023-07-29T17:09:09.802289+0000","last_clean":"2023-07-29T17:09:09.802289+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:09.802289+0000","last_undegraded":"2023-07-29T17:09:09.802289+0000","last_fullsized":"2023-07-29T17:09:09.802289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799679+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:09.799679+0000","last_peered":"2023-07-29T17:09:09.799679+0000","last_clean":"2023-07-29T17:09:09.799679+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:09.799679+0000","last_undegraded":"2023-07-29T17:09:09.799679+0000","last_fullsized":"2023-07-29T17:09:09.799679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800393+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:09.800393+0000","last_peered":"2023-07-29T17:09:09.800393+0000","last_clean":"2023-07-29T17:09:09.800393+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:09.800393+0000","last_undegraded":"2023-07-29T17:09:09.800393+0000","last_fullsized":"2023-07-29T17:09:09.800393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799561+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:09.799561+0000","last_peered":"2023-07-29T17:09:09.799561+0000","last_clean":"2023-07-29T17:09:09.799561+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:09.799561+0000","last_undegraded":"2023-07-29T17:09:09.799561+0000","last_fullsized":"2023-07-29T17:09:09.799561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803182+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:09.803182+0000","last_peered":"2023-07-29T17:09:09.803182+0000","last_clean":"2023-07-29T17:09:09.803182+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:09.803182+0000","last_undegraded":"2023-07-29T17:09:09.803182+0000","last_fullsized":"2023-07-29T17:09:09.803182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800416+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:09.800416+0000","last_peered":"2023-07-29T17:09:09.800416+0000","last_clean":"2023-07-29T17:09:09.800416+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:09.800416+0000","last_undegraded":"2023-07-29T17:09:09.800416+0000","last_fullsized":"2023-07-29T17:09:09.800416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799262+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:09.799262+0000","last_peered":"2023-07-29T17:09:09.799262+0000","last_clean":"2023-07-29T17:09:09.799262+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:09.799262+0000","last_undegraded":"2023-07-29T17:09:09.799262+0000","last_fullsized":"2023-07-29T17:09:09.799262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802824+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:09.802824+0000","last_peered":"2023-07-29T17:09:09.802824+0000","last_clean":"2023-07-29T17:09:09.802824+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:09.802824+0000","last_undegraded":"2023-07-29T17:09:09.802824+0000","last_fullsized":"2023-07-29T17:09:09.802824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799822+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:09.799822+0000","last_peered":"2023-07-29T17:09:09.799822+0000","last_clean":"2023-07-29T17:09:09.799822+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:09.799822+0000","last_undegraded":"2023-07-29T17:09:09.799822+0000","last_fullsized":"2023-07-29T17:09:09.799822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802829+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:09.802829+0000","last_peered":"2023-07-29T17:09:09.802829+0000","last_clean":"2023-07-29T17:09:09.802829+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:09.802829+0000","last_undegraded":"2023-07-29T17:09:09.802829+0000","last_fullsized":"2023-07-29T17:09:09.802829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799657+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:09.799657+0000","last_peered":"2023-07-29T17:09:09.799657+0000","last_clean":"2023-07-29T17:09:09.799657+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:09.799657+0000","last_undegraded":"2023-07-29T17:09:09.799657+0000","last_fullsized":"2023-07-29T17:09:09.799657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802986+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:09.802986+0000","last_peered":"2023-07-29T17:09:09.802986+0000","last_clean":"2023-07-29T17:09:09.802986+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:09.802986+0000","last_undegraded":"2023-07-29T17:09:09.802986+0000","last_fullsized":"2023-07-29T17:09:09.802986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803117+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:09.803117+0000","last_peered":"2023-07-29T17:09:09.803117+0000","last_clean":"2023-07-29T17:09:09.803117+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:09.803117+0000","last_undegraded":"2023-07-29T17:09:09.803117+0000","last_fullsized":"2023-07-29T17:09:09.803117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802999+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:09.802999+0000","last_peered":"2023-07-29T17:09:09.802999+0000","last_clean":"2023-07-29T17:09:09.802999+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:09.802999+0000","last_undegraded":"2023-07-29T17:09:09.802999+0000","last_fullsized":"2023-07-29T17:09:09.802999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802444+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:09.802444+0000","last_peered":"2023-07-29T17:09:09.802444+0000","last_clean":"2023-07-29T17:09:09.802444+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:09.802444+0000","last_undegraded":"2023-07-29T17:09:09.802444+0000","last_fullsized":"2023-07-29T17:09:09.802444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799964+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:09.799964+0000","last_peered":"2023-07-29T17:09:09.799964+0000","last_clean":"2023-07-29T17:09:09.799964+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:09.799964+0000","last_undegraded":"2023-07-29T17:09:09.799964+0000","last_fullsized":"2023-07-29T17:09:09.799964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802937+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:09.802937+0000","last_peered":"2023-07-29T17:09:09.802937+0000","last_clean":"2023-07-29T17:09:09.802937+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:09.802937+0000","last_undegraded":"2023-07-29T17:09:09.802937+0000","last_fullsized":"2023-07-29T17:09:09.802937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802271+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:09.802271+0000","last_peered":"2023-07-29T17:09:09.802271+0000","last_clean":"2023-07-29T17:09:09.802271+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:09.802271+0000","last_undegraded":"2023-07-29T17:09:09.802271+0000","last_fullsized":"2023-07-29T17:09:09.802271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800321+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:09.800321+0000","last_peered":"2023-07-29T17:09:09.800321+0000","last_clean":"2023-07-29T17:09:09.800321+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:09.800321+0000","last_undegraded":"2023-07-29T17:09:09.800321+0000","last_fullsized":"2023-07-29T17:09:09.800321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802435+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:09.802435+0000","last_peered":"2023-07-29T17:09:09.802435+0000","last_clean":"2023-07-29T17:09:09.802435+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:09.802435+0000","last_undegraded":"2023-07-29T17:09:09.802435+0000","last_fullsized":"2023-07-29T17:09:09.802435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800481+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:09.800481+0000","last_peered":"2023-07-29T17:09:09.800481+0000","last_clean":"2023-07-29T17:09:09.800481+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:09.800481+0000","last_undegraded":"2023-07-29T17:09:09.800481+0000","last_fullsized":"2023-07-29T17:09:09.800481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803045+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:09.803045+0000","last_peered":"2023-07-29T17:09:09.803045+0000","last_clean":"2023-07-29T17:09:09.803045+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:09.803045+0000","last_undegraded":"2023-07-29T17:09:09.803045+0000","last_fullsized":"2023-07-29T17:09:09.803045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.801933+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:09.801933+0000","last_peered":"2023-07-29T17:09:09.801933+0000","last_clean":"2023-07-29T17:09:09.801933+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:09.801933+0000","last_undegraded":"2023-07-29T17:09:09.801933+0000","last_fullsized":"2023-07-29T17:09:09.801933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802831+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:09.802831+0000","last_peered":"2023-07-29T17:09:09.802831+0000","last_clean":"2023-07-29T17:09:09.802831+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:09.802831+0000","last_undegraded":"2023-07-29T17:09:09.802831+0000","last_fullsized":"2023-07-29T17:09:09.802831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802407+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:09.802407+0000","last_peered":"2023-07-29T17:09:09.802407+0000","last_clean":"2023-07-29T17:09:09.802407+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:09.802407+0000","last_undegraded":"2023-07-29T17:09:09.802407+0000","last_fullsized":"2023-07-29T17:09:09.802407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803215+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:09.803215+0000","last_peered":"2023-07-29T17:09:09.803215+0000","last_clean":"2023-07-29T17:09:09.803215+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:09.803215+0000","last_undegraded":"2023-07-29T17:09:09.803215+0000","last_fullsized":"2023-07-29T17:09:09.803215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802676+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:09.802676+0000","last_peered":"2023-07-29T17:09:09.802676+0000","last_clean":"2023-07-29T17:09:09.802676+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:09.802676+0000","last_undegraded":"2023-07-29T17:09:09.802676+0000","last_fullsized":"2023-07-29T17:09:09.802676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802683+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:09.802683+0000","last_peered":"2023-07-29T17:09:09.802683+0000","last_clean":"2023-07-29T17:09:09.802683+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:09.802683+0000","last_undegraded":"2023-07-29T17:09:09.802683+0000","last_fullsized":"2023-07-29T17:09:09.802683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799851+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:09.799851+0000","last_peered":"2023-07-29T17:09:09.799851+0000","last_clean":"2023-07-29T17:09:09.799851+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:09.799851+0000","last_undegraded":"2023-07-29T17:09:09.799851+0000","last_fullsized":"2023-07-29T17:09:09.799851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799799+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:09.799799+0000","last_peered":"2023-07-29T17:09:09.799799+0000","last_clean":"2023-07-29T17:09:09.799799+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:09.799799+0000","last_undegraded":"2023-07-29T17:09:09.799799+0000","last_fullsized":"2023-07-29T17:09:09.799799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802834+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:09.802834+0000","last_peered":"2023-07-29T17:09:09.802834+0000","last_clean":"2023-07-29T17:09:09.802834+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:09.802834+0000","last_undegraded":"2023-07-29T17:09:09.802834+0000","last_fullsized":"2023-07-29T17:09:09.802834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802472+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:09.802472+0000","last_peered":"2023-07-29T17:09:09.802472+0000","last_clean":"2023-07-29T17:09:09.802472+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:09.802472+0000","last_undegraded":"2023-07-29T17:09:09.802472+0000","last_fullsized":"2023-07-29T17:09:09.802472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803414+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:09.803414+0000","last_peered":"2023-07-29T17:09:09.803414+0000","last_clean":"2023-07-29T17:09:09.803414+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:09.803414+0000","last_undegraded":"2023-07-29T17:09:09.803414+0000","last_fullsized":"2023-07-29T17:09:09.803414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802004+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:09.802004+0000","last_peered":"2023-07-29T17:09:09.802004+0000","last_clean":"2023-07-29T17:09:09.802004+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:09.802004+0000","last_undegraded":"2023-07-29T17:09:09.802004+0000","last_fullsized":"2023-07-29T17:09:09.802004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802958+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:09.802958+0000","last_peered":"2023-07-29T17:09:09.802958+0000","last_clean":"2023-07-29T17:09:09.802958+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:09.802958+0000","last_undegraded":"2023-07-29T17:09:09.802958+0000","last_fullsized":"2023-07-29T17:09:09.802958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802075+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:09.802075+0000","last_peered":"2023-07-29T17:09:09.802075+0000","last_clean":"2023-07-29T17:09:09.802075+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:09.802075+0000","last_undegraded":"2023-07-29T17:09:09.802075+0000","last_fullsized":"2023-07-29T17:09:09.802075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800349+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:09.800349+0000","last_peered":"2023-07-29T17:09:09.800349+0000","last_clean":"2023-07-29T17:09:09.800349+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:09.800349+0000","last_undegraded":"2023-07-29T17:09:09.800349+0000","last_fullsized":"2023-07-29T17:09:09.800349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795983+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:08.795983+0000","last_peered":"2023-07-29T17:09:08.795983+0000","last_clean":"2023-07-29T17:09:08.795983+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:08.795983+0000","last_undegraded":"2023-07-29T17:09:08.795983+0000","last_fullsized":"2023-07-29T17:09:08.795983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803302+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:09.803302+0000","last_peered":"2023-07-29T17:09:09.803302+0000","last_clean":"2023-07-29T17:09:09.803302+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:09.803302+0000","last_undegraded":"2023-07-29T17:09:09.803302+0000","last_fullsized":"2023-07-29T17:09:09.803302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802403+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:09.802403+0000","last_peered":"2023-07-29T17:09:09.802403+0000","last_clean":"2023-07-29T17:09:09.802403+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:09.802403+0000","last_undegraded":"2023-07-29T17:09:09.802403+0000","last_fullsized":"2023-07-29T17:09:09.802403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800377+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:08.800377+0000","last_peered":"2023-07-29T17:09:08.800377+0000","last_clean":"2023-07-29T17:09:08.800377+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:08.800377+0000","last_undegraded":"2023-07-29T17:09:08.800377+0000","last_fullsized":"2023-07-29T17:09:08.800377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803059+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:09.803059+0000","last_peered":"2023-07-29T17:09:09.803059+0000","last_clean":"2023-07-29T17:09:09.803059+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:09.803059+0000","last_undegraded":"2023-07-29T17:09:09.803059+0000","last_fullsized":"2023-07-29T17:09:09.803059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799819+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:09.799819+0000","last_peered":"2023-07-29T17:09:09.799819+0000","last_clean":"2023-07-29T17:09:09.799819+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:09.799819+0000","last_undegraded":"2023-07-29T17:09:09.799819+0000","last_fullsized":"2023-07-29T17:09:09.799819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.795713+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:08.795713+0000","last_peered":"2023-07-29T17:09:08.795713+0000","last_clean":"2023-07-29T17:09:08.795713+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:08.795713+0000","last_undegraded":"2023-07-29T17:09:08.795713+0000","last_fullsized":"2023-07-29T17:09:08.795713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802068+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:09.802068+0000","last_peered":"2023-07-29T17:09:09.802068+0000","last_clean":"2023-07-29T17:09:09.802068+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:09.802068+0000","last_undegraded":"2023-07-29T17:09:09.802068+0000","last_fullsized":"2023-07-29T17:09:09.802068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800433+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:09.800433+0000","last_peered":"2023-07-29T17:09:09.800433+0000","last_clean":"2023-07-29T17:09:09.800433+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:09.800433+0000","last_undegraded":"2023-07-29T17:09:09.800433+0000","last_fullsized":"2023-07-29T17:09:09.800433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799891+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:08.799891+0000","last_peered":"2023-07-29T17:09:08.799891+0000","last_clean":"2023-07-29T17:09:08.799891+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:08.799891+0000","last_undegraded":"2023-07-29T17:09:08.799891+0000","last_fullsized":"2023-07-29T17:09:08.799891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799176+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:08.799176+0000","last_peered":"2023-07-29T17:09:08.799176+0000","last_clean":"2023-07-29T17:09:08.799176+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:08.799176+0000","last_undegraded":"2023-07-29T17:09:08.799176+0000","last_fullsized":"2023-07-29T17:09:08.799176+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799606+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:09.799606+0000","last_peered":"2023-07-29T17:09:09.799606+0000","last_clean":"2023-07-29T17:09:09.799606+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:09.799606+0000","last_undegraded":"2023-07-29T17:09:09.799606+0000","last_fullsized":"2023-07-29T17:09:09.799606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803317+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:09.803317+0000","last_peered":"2023-07-29T17:09:09.803317+0000","last_clean":"2023-07-29T17:09:09.803317+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:09.803317+0000","last_undegraded":"2023-07-29T17:09:09.803317+0000","last_fullsized":"2023-07-29T17:09:09.803317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.799883+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:08.799883+0000","last_peered":"2023-07-29T17:09:08.799883+0000","last_clean":"2023-07-29T17:09:08.799883+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:08.799883+0000","last_undegraded":"2023-07-29T17:09:08.799883+0000","last_fullsized":"2023-07-29T17:09:08.799883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799331+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:09.799331+0000","last_peered":"2023-07-29T17:09:09.799331+0000","last_clean":"2023-07-29T17:09:09.799331+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:09.799331+0000","last_undegraded":"2023-07-29T17:09:09.799331+0000","last_fullsized":"2023-07-29T17:09:09.799331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803010+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:09.803010+0000","last_peered":"2023-07-29T17:09:09.803010+0000","last_clean":"2023-07-29T17:09:09.803010+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:09.803010+0000","last_undegraded":"2023-07-29T17:09:09.803010+0000","last_fullsized":"2023-07-29T17:09:09.803010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.797644+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:08.797644+0000","last_peered":"2023-07-29T17:09:08.797644+0000","last_clean":"2023-07-29T17:09:08.797644+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:08.797644+0000","last_undegraded":"2023-07-29T17:09:08.797644+0000","last_fullsized":"2023-07-29T17:09:08.797644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799990+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:09.799990+0000","last_peered":"2023-07-29T17:09:09.799990+0000","last_clean":"2023-07-29T17:09:09.799990+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:09.799990+0000","last_undegraded":"2023-07-29T17:09:09.799990+0000","last_fullsized":"2023-07-29T17:09:09.799990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802615+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:09.802615+0000","last_peered":"2023-07-29T17:09:09.802615+0000","last_clean":"2023-07-29T17:09:09.802615+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:09.802615+0000","last_undegraded":"2023-07-29T17:09:09.802615+0000","last_fullsized":"2023-07-29T17:09:09.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800260+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:09.800260+0000","last_peered":"2023-07-29T17:09:09.800260+0000","last_clean":"2023-07-29T17:09:09.800260+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:09.800260+0000","last_undegraded":"2023-07-29T17:09:09.800260+0000","last_fullsized":"2023-07-29T17:09:09.800260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.796176+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:08.796176+0000","last_peered":"2023-07-29T17:09:08.796176+0000","last_clean":"2023-07-29T17:09:08.796176+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:08.796176+0000","last_undegraded":"2023-07-29T17:09:08.796176+0000","last_fullsized":"2023-07-29T17:09:08.796176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799280+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:09.799280+0000","last_peered":"2023-07-29T17:09:09.799280+0000","last_clean":"2023-07-29T17:09:09.799280+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:09.799280+0000","last_undegraded":"2023-07-29T17:09:09.799280+0000","last_fullsized":"2023-07-29T17:09:09.799280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T17:09:08.800960+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:08.800960+0000","last_peered":"2023-07-29T17:09:08.800960+0000","last_clean":"2023-07-29T17:09:08.800960+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:08.800960+0000","last_undegraded":"2023-07-29T17:09:08.800960+0000","last_fullsized":"2023-07-29T17:09:08.800960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634367+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:10.634367+0000","last_peered":"2023-07-29T17:09:10.634367+0000","last_clean":"2023-07-29T17:09:10.634367+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:10.634367+0000","last_undegraded":"2023-07-29T17:09:10.634367+0000","last_fullsized":"2023-07-29T17:09:10.634367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802268+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:09.802268+0000","last_peered":"2023-07-29T17:09:09.802268+0000","last_clean":"2023-07-29T17:09:09.802268+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:09.802268+0000","last_undegraded":"2023-07-29T17:09:09.802268+0000","last_fullsized":"2023-07-29T17:09:09.802268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802385+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:09.802385+0000","last_peered":"2023-07-29T17:09:09.802385+0000","last_clean":"2023-07-29T17:09:09.802385+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:09.802385+0000","last_undegraded":"2023-07-29T17:09:09.802385+0000","last_fullsized":"2023-07-29T17:09:09.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802908+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:09.802908+0000","last_peered":"2023-07-29T17:09:09.802908+0000","last_clean":"2023-07-29T17:09:09.802908+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:09.802908+0000","last_undegraded":"2023-07-29T17:09:09.802908+0000","last_fullsized":"2023-07-29T17:09:09.802908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802943+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:09.802943+0000","last_peered":"2023-07-29T17:09:09.802943+0000","last_clean":"2023-07-29T17:09:09.802943+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:09.802943+0000","last_undegraded":"2023-07-29T17:09:09.802943+0000","last_fullsized":"2023-07-29T17:09:09.802943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802760+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:09.802760+0000","last_peered":"2023-07-29T17:09:09.802760+0000","last_clean":"2023-07-29T17:09:09.802760+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:09.802760+0000","last_undegraded":"2023-07-29T17:09:09.802760+0000","last_fullsized":"2023-07-29T17:09:09.802760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802787+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:09.802787+0000","last_peered":"2023-07-29T17:09:09.802787+0000","last_clean":"2023-07-29T17:09:09.802787+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:09.802787+0000","last_undegraded":"2023-07-29T17:09:09.802787+0000","last_fullsized":"2023-07-29T17:09:09.802787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802667+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:09.802667+0000","last_peered":"2023-07-29T17:09:09.802667+0000","last_clean":"2023-07-29T17:09:09.802667+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:09.802667+0000","last_undegraded":"2023-07-29T17:09:09.802667+0000","last_fullsized":"2023-07-29T17:09:09.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800463+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:09.800463+0000","last_peered":"2023-07-29T17:09:09.800463+0000","last_clean":"2023-07-29T17:09:09.800463+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:09.800463+0000","last_undegraded":"2023-07-29T17:09:09.800463+0000","last_fullsized":"2023-07-29T17:09:09.800463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802479+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:09.802479+0000","last_peered":"2023-07-29T17:09:09.802479+0000","last_clean":"2023-07-29T17:09:09.802479+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:09.802479+0000","last_undegraded":"2023-07-29T17:09:09.802479+0000","last_fullsized":"2023-07-29T17:09:09.802479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800343+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:09.800343+0000","last_peered":"2023-07-29T17:09:09.800343+0000","last_clean":"2023-07-29T17:09:09.800343+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:09.800343+0000","last_undegraded":"2023-07-29T17:09:09.800343+0000","last_fullsized":"2023-07-29T17:09:09.800343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802807+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:09.802807+0000","last_peered":"2023-07-29T17:09:09.802807+0000","last_clean":"2023-07-29T17:09:09.802807+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:09.802807+0000","last_undegraded":"2023-07-29T17:09:09.802807+0000","last_fullsized":"2023-07-29T17:09:09.802807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802376+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:09.802376+0000","last_peered":"2023-07-29T17:09:09.802376+0000","last_clean":"2023-07-29T17:09:09.802376+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:09.802376+0000","last_undegraded":"2023-07-29T17:09:09.802376+0000","last_fullsized":"2023-07-29T17:09:09.802376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799446+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:09.799446+0000","last_peered":"2023-07-29T17:09:09.799446+0000","last_clean":"2023-07-29T17:09:09.799446+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:09.799446+0000","last_undegraded":"2023-07-29T17:09:09.799446+0000","last_fullsized":"2023-07-29T17:09:09.799446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802430+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:09.802430+0000","last_peered":"2023-07-29T17:09:09.802430+0000","last_clean":"2023-07-29T17:09:09.802430+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:09.802430+0000","last_undegraded":"2023-07-29T17:09:09.802430+0000","last_fullsized":"2023-07-29T17:09:09.802430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799949+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:09.799949+0000","last_peered":"2023-07-29T17:09:09.799949+0000","last_clean":"2023-07-29T17:09:09.799949+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:09.799949+0000","last_undegraded":"2023-07-29T17:09:09.799949+0000","last_fullsized":"2023-07-29T17:09:09.799949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803004+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:09.803004+0000","last_peered":"2023-07-29T17:09:09.803004+0000","last_clean":"2023-07-29T17:09:09.803004+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:09.803004+0000","last_undegraded":"2023-07-29T17:09:09.803004+0000","last_fullsized":"2023-07-29T17:09:09.803004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":649811,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":650427,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:27.899 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T17:09:27.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-07-29T17:09:28.251 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 19 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:fsid a332a6fa-930f-490b-a8e4-4300ea7abc2a 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-07-29T17:08:46.582422+0000 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2023-07-29T17:09:09.793498+0000 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 4 2023-07-29T17:09:28.252 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client jewel 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release reef 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2023-07-29T17:09:28.253 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 3 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/110190,v1:172.21.15.92:6801/110190] [v2:172.21.15.92:6802/110190,v1:172.21.15.92:6803/110190] exists,up 973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6800/110230,v1:172.21.15.93:6801/110230] [v2:172.21.15.93:6802/110230,v1:172.21.15.93:6803/110230] exists,up ee52c2b3-837b-4ab3-8826-4fae9cff4ee7 2023-07-29T17:09:28.254 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/110381,v1:172.21.15.153:6801/110381] [v2:172.21.15.153:6802/110381,v1:172.21.15.153:6803/110381] exists,up 940667e0-3fe5-459e-8934-96e6b34a39ec 2023-07-29T17:09:28.265 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/110190,v1:172.21.15.92:6801/110190] [v2:172.21.15.92:6802/110190,v1:172.21.15.92:6803/110190] exists,up 973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6800/110230,v1:172.21.15.93:6801/110230] [v2:172.21.15.93:6802/110230,v1:172.21.15.93:6803/110230] exists,up ee52c2b3-837b-4ab3-8826-4fae9cff4ee7', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/110381,v1:172.21.15.153:6801/110381] [v2:172.21.15.153:6802/110381,v1:172.21.15.153:6803/110381] exists,up 940667e0-3fe5-459e-8934-96e6b34a39ec'] 2023-07-29T17:09:28.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-07-29T17:09:28.387 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-07-29T17:09:28.387 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mon.a", 2023-07-29T17:09:28.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster": "ceph", 2023-07-29T17:09:28.387 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-07-29T17:09:28.387 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket_mode": "", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_client_required": "cephx, none", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_cluster_required": "cephx", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_debug": "true", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-07-29T17:09:28.388 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_required": "cephx", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_ticket_ttl": "240.000000", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_supported": "cephx", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio": "true", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_max_queue_depth": "1024", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_poll_ms": "250", 2023-07-29T17:09:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_reap_max": "16", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_async_discard": "false", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_block_size": "4096", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio": "false", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_inflight_ios": "false", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_enable_discard": "false", 2023-07-29T17:09:28.390 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry": "3", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry_interval": "0.100000", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash": "0", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash_flush_delay": "2", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring": "false", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_hipri": "false", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_sqthread_poll": "false", 2023-07-29T17:09:28.391 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_buffer_alignment": "4096", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_type": "", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_alloc_size": "1048576", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_allocator": "hybrid", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_buffered_io": "true", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_for_zeros": "false", 2023-07-29T17:09:28.392 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_often": "false", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_compact_log_sync": "false", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_size": "16777216", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_replay_check_allocations": "true", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_log_runway": "4194304", 2023-07-29T17:09:28.393 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_prefetch": "1048576", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_flush_size": "524288", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_log_runway": "1048576", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery": "false", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_shared_alloc_size": "65536", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_sync_write": "false", 2023-07-29T17:09:28.394 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocation_from_file": "true", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocator": "hybrid", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-07-29T17:09:28.395 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blobid_prealloc": "10240", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_create": "true", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_create": "false", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_path": "", 2023-07-29T17:09:28.396 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_size": "0", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_path": "", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_preallocate_file": "false", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_size": "107374182400", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_create": "false", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_path": "", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_size": "100663296", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs": "true", 2023-07-29T17:09:28.397 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_env_mirror": "false", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T17:09:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune": "true", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size": "0", 2023-07-29T17:09:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-07-29T17:09:28.400 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-07-29T17:09:28.400 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-07-29T17:09:28.400 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-07-29T17:09:28.400 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_type": "2q", 2023-07-29T17:09:28.405 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-07-29T17:09:28.405 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_clone_cow": "true", 2023-07-29T17:09:28.405 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_algorithm": "snappy", 2023-07-29T17:09:28.405 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size": "0", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size": "0", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_mode": "none", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-07-29T17:09:28.406 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_csum_type": "crc32c", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_enforce_settings": "default", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_freelist": "false", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_fsck_abort": "false", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_bug21040": "false", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_read_err": "false", 2023-07-29T17:09:28.407 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_legacy_omap": "false", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefill": "0.000000", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-07-29T17:09:28.408 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_small_allocations": "0", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_read": "true", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_write": "false", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops": "0", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-07-29T17:09:28.409 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fail_eio": "false", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-07-29T17:09:28.410 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs": "true", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount": "false", 2023-07-29T17:09:28.411 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-07-29T17:09:28.412 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_ignore_data_csum": "false", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kvbackend": "rocksdb", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_op_age": "5.000000", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_alloc_size": "0", 2023-07-29T17:09:28.413 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size": "0", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_defer_interval": "3.000000", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_deferred_txc": "32", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size": "0", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-07-29T17:09:28.414 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_nid_prealloc": "1024", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size": "0", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_qfsck_on_mount": "true", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_retry_disk_reads": "3", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cf": "true", 2023-07-29T17:09:28.415 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options_annex": "", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_coremask": "0x1", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_io_sleep": "5", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_max_io_completion": "0", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_mem": "512", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_sync_submit_transaction": "false", 2023-07-29T17:09:28.416 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_bytes": "67108864", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io": "0", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_tracing": "false", 2023-07-29T17:09:28.417 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved": "0", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-07-29T17:09:28.418 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_zero_block_detection": "false", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_action_update_interval": "2", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-07-29T17:09:28.419 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_mount_timeout": "10", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_signatures": "false", 2023-07-29T17:09:28.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_version": "2", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_signatures": "false", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_version": "2", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_signatures": "false", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_version": "2", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_sign_messages": "true", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "chdir": "", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "client_acl_type": "", 2023-07-29T17:09:28.421 INFO:teuthology.orchestra.run.smithi073.stdout: "client_asio_thread_count": "2", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_mid": "0.750000", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_size": "16384", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_caps_release_delay": "5", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_check_pool_perm": "true", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_collect_and_send_global_metrics": "false", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_force_sync_read": "false", 2023-07-29T17:09:28.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_getattr_caps": "false", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_inject_tick_delay": "0", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_remount": "false", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_dirsize_rbytes": "true", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_force_lazyio": "false", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_fs": "", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_fixed_oldest_tid": "false", 2023-07-29T17:09:28.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_release_failure": "false", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_inline_size": "4096", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_retries_on_remount_failure": "5", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mds_namespace": "", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_metadata": "", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_gid": "-1", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_timeout": "300", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_uid": "-1", 2023-07-29T17:09:28.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mountpoint": "/", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_notify_timeout": "10", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc": "true", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty": "104857600", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty_age": "5.000000", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_objects": "1000", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_size": "209715200", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_target_dirty": "8388608", 2023-07-29T17:09:28.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_permissions": "true", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota": "true", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota_df": "true", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_bytes": "0", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_periods": "4", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_min": "131072", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_reconnect_stale": "false", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_shutdown_timeout": "30", 2023-07-29T17:09:28.426 INFO:teuthology.orchestra.run.smithi073.stdout: "client_snapdir": ".snap", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "client_tick_interval": "1", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "client_trace": "", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "client_try_dentry_invalidate": "false", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_faked_inos": "false", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_random_mds": "false", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog": "false", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-07-29T17:09:28.427 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_port": "12201", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_monitors": "default=true", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog": "false", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_level": "info", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "-", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network": "", 2023-07-29T17:09:28.428 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network_interface": "", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_isal": "false", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_level": "5", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_winsize": "-15", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zstd_level": "1", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_op_num_threads": "6", 2023-07-29T17:09:28.429 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_thread_cpu_cores": "", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_obc_lru_size": "10", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_seastar_smp": "1", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook": "", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook_timeout": "10", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "daemonize": "false", 2023-07-29T17:09:28.430 INFO:teuthology.orchestra.run.smithi073.stdout: "daos_pool": "tank", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_name_prefix": "dbstore", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_alienstore": "0/5", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_allow_any_pool_priority": "false", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok": "1/5", 2023-07-29T17:09:28.431 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok_assert_abort": "false", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asserts_on_shutdown": "true", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_auth": "20/20", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bdev": "1/3", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluefs": "1/5", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluestore": "1/5", 2023-07-29T17:09:28.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_buffer": "0/1", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ceph_exporter": "1/5", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephfs_mirror": "0/5", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephsqlite": "0/5", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_client": "0/5", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_compressor": "1/5", 2023-07-29T17:09:28.433 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_context": "0/1", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crush": "1/1", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crypto": "1/5", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cyanstore": "0/5", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_deliberately_leak_memory": "false", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_disable_randomized_ping": "false", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_dpdk": "1/5", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_eventtrace": "1/5", 2023-07-29T17:09:28.434 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filer": "0/1", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filestore": "1/3", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_finisher": "1/1", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_fuse": "1/5", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeat_testing_span": "0", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeatmap": "1/5", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_immutable_obj_cache": "0/5", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_javaclient": "1/5", 2023-07-29T17:09:28.435 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journal": "1/3", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journaler": "0/5", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_kstore": "1/5", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_leveldb": "4/5", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_lockdep": "0/1", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mclock": "1/5", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds": "1/5", 2023-07-29T17:09:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_balancer": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_locker": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log_expire": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_migrator": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_memstore": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgr": "2/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgrc": "1/5", 2023-07-29T17:09:28.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mon": "20/20", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_monc": "0/10", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ms": "1/1", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_none": "0/5", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objclass": "0/5", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objectcacher": "0/5", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objecter": "0/1", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_optracker": "0/5", 2023-07-29T17:09:28.438 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_osd": "1/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_paxos": "20/20", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_perfcounter": "1/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_prioritycache": "1/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rados": "0/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd": "0/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_mirror": "0/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_pwl": "0/5", 2023-07-29T17:09:28.439 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_replay": "0/5", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_refs": "0/0", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_reserver": "1/1", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw": "1/5", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_access": "1/5", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_datacache": "1/5", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_dbstore": "1/5", 2023-07-29T17:09:28.440 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_flight": "1/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_sync": "1/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rocksdb": "4/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore": "0/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_backref": "0/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cache": "0/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cleaner": "0/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_device": "0/5", 2023-07-29T17:09:28.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_epm": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_journal": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_lba": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_odata": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_omap": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_onode": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_t": "0/5", 2023-07-29T17:09:28.442 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_tm": "0/5", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_striper": "0/1", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_test": "0/5", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_throttle": "1/1", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_timer": "0/1", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_tp": "0/5", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "device_failure_prediction_mode": "none", 2023-07-29T17:09:28.443 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_graylog": "false", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_journald": "false", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_stderr": "true", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_syslog": "false", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event_tracing": "false", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_addr": "0.0.0.0", 2023-07-29T17:09:28.444 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_http_port": "9926", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_prio_limit": "5", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sort_metrics": "true", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_stats_period": "5", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "fake_statfs_for_testing": "0", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "fatal_signal_handlers": "true", 2023-07-29T17:09:28.445 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_purge_ops": "10", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_truncate_ops": "128", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_apply_finisher_threads": "1", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_blackhole": "false", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_clone_range": "true", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_snap": "true", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_caller_concurrency": "10", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_collect_device_partition_information": "true", 2023-07-29T17:09:28.446 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_commit_timeout": "600.000000", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_inject_read_err": "false", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_omap_check": "false", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_random_read_err": "0.000000", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_verify_split": "false", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_dump_file": "", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-07-29T17:09:28.447 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fadvise": "true", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fail_eio": "true", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_shards": "16", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_size": "128", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap": "false", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap_threshold": "4096", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_index_retry_probability": "0.000000", 2023-07-29T17:09:28.448 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_inject_stall": "0", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_parallel": "false", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_trailing": "false", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_writeahead": "false", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_kill_at": "0", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size": "0", 2023-07-29T17:09:28.449 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs": "0", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_other": "2", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_sync_interval": "5.000000", 2023-07-29T17:09:28.450 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size": "0", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_merge_threshold": "-10", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_min_sync_interval": "0.010000", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_odsync_write": "false", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend": "rocksdb", 2023-07-29T17:09:28.451 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend_path": "", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_header_cache_size": "1024", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_ondisk_finisher_threads": "1", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_timeout": "60", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_threads": "2", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_punch_hole": "false", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-07-29T17:09:28.452 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_bytes": "104857600", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-07-29T17:09:28.453 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_ops": "50", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_seek_data_hole": "false", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc": "false", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_splice": "false", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_multiple": "2", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_rand_factor": "20", 2023-07-29T17:09:28.454 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_update_to": "1000", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-07-29T17:09:28.455 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_enable": "true", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_xfs_extsize": "false", 2023-07-29T17:09:28.456 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_zfs_snap": "false", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fio_dir": "/tmp/fio", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "a332a6fa-930f-490b-a8e4-4300ea7abc2a", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_allow_other": "true", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_atomic_o_trunc": "true", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_big_writes": "true", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_debug": "false", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_default_permissions": "false", 2023-07-29T17:09:28.457 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_disable_pagecache": "false", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_max_write": "0", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_multithreaded": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_require_active_mds": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_set_user_groups": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_move": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_read": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_write": "true", 2023-07-29T17:09:28.458 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_syncfs_on_mksnap": "true", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_use_invalidate_cb": "true", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_target_name": "ceph", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_file": "", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_inject_failure": "0", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_interval": "5", 2023-07-29T17:09:28.459 INFO:teuthology.orchestra.run.smithi073.stdout: "host": "smithi073", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_size": "1073741824", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-07-29T17:09:28.460 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_watermark": "0.900000", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "inject_early_sigterm": "false", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_agent_port": "6799", 2023-07-29T17:09:28.461 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_tracing_enable": "false", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_aio": "true", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_align_min_size": "65536", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_align": "true", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_size": "4096", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_dio": "true", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_discard": "false", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_force_aio": "false", 2023-07-29T17:09:28.462 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_ignore_corruption": "false", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_bytes": "10485760", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_entries": "100", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_replay_from": "0", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_multiple": "0.000000", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-07-29T17:09:28.463 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_max_multiple": "0.000000", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_write_header_frequency": "0", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_zero_on_create": "false", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prefetch_periods": "10", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prezero_periods": "5", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_write_head_interval": "15", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "keyfile": "", 2023-07-29T17:09:28.464 INFO:teuthology.orchestra.run.smithi073.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_backend": "rocksdb", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_default_stripe_size": "65536", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount": "false", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount_deep": "true", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_bytes": "67108864", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_ops": "512", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_nid_prealloc": "1024", 2023-07-29T17:09:28.465 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_onode_map_size": "1024", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_submit_transaction": "false", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_transaction": "false", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_block_size": "65536", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_bloom_size": "0", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_cache_size": "536870912", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compact_on_mount": "false", 2023-07-29T17:09:28.466 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compression": "false", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log": "", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log_to_ceph_log": "true", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_max_open_files": "0", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_paranoid": "false", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_write_buffer_size": "33554432", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "librados_thread_count": "2", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep": "false", 2023-07-29T17:09:28.467 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep_force_backtrace": "false", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_coarse_timestamps": "true", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_flush_on_exit": "false", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_host": "127.0.0.1", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_port": "12201", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_new": "1000", 2023-07-29T17:09:28.468 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_recent": "10000", 2023-07-29T17:09:28.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stderr_prefix": "", 2023-07-29T17:09:28.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stop_at_utilization": "0.970000", 2023-07-29T17:09:28.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": "true", 2023-07-29T17:09:28.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_graylog": "false", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_journald": "false", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_stderr": "false", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_syslog": "false", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max_rotating_auth_attempts": "10", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_action_on_write_error": "1", 2023-07-29T17:09:28.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_alternate_name_max": "8192", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_asio_thread_count": "2", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_export_pin": "true", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_dirs": "true", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_interval": "5", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_size_max": "100000", 2023-07-29T17:09:28.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_idle_threshold": "0.000000", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_interval": "10", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max": "-1", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max_until": "-1", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_merge_size": "50", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_midchunk": "0.300000", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_rebalance": "0.100000", 2023-07-29T17:09:28.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_start": "0.200000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_minchunk": "0.001000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_mode": "0", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_max": "1.200000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_min": "0.800000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_sample_interval": "3.000000", 2023-07-29T17:09:28.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_bits": "3", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_rd": "25000.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_size": "10000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_wr": "10000.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_target_decay": "10.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_grace": "15.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_interval": "4.000000", 2023-07-29T17:09:28.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_mon_down_grace": "60", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_memory_limit": "4294967296", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_mid": "0.700000", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_release_free_interval": "10", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_reservation": "0.050000", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_interval": "1", 2023-07-29T17:09:28.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_threshold": "262144", 2023-07-29T17:09:28.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-07-29T17:09:28.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-07-29T17:09:28.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_delegate_inos_pct": "50", 2023-07-29T17:09:28.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_prealloc_inos": "1000", 2023-07-29T17:09:28.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_connect_bootstrapping": "false", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_damage_table_max_entries": "10000", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_auth_pins": "false", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_frag": "false", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_scatterstat": "false", 2023-07-29T17:09:28.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_subtrees": "false", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_decay_halflife": "5.000000", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_default_dir_hash": "2", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_defer_session_stale": "true", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_deny_all_reconnect": "false", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_keys_per_op": "16384", 2023-07-29T17:09:28.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_commit_size": "10", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_entries": "0", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_prefetch": "true", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dirstat_min_interval": "1.000000", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_after_rejoin": "false", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_on_map": "false", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_file": "0", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-07-29T17:09:28.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_early_reply": "true", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enable_op_tracker": "true", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enforce_unique_name": "true", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed": "true", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random": "true", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-07-29T17:09:28.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_forward_all_requests_to_auth": "false", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_cache_threshold": "1.500000", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_summarize_threshold": "10", 2023-07-29T17:09:28.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_grace": "15.000000", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_reset_grace": "1000", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_health_dummy": "false", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_migrator_session_race": "false", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-07-29T17:09:28.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_join_fs": "", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_journal_format": "1", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_create_at": "0", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_export_at": "0", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_import_at": "0", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_at": "0", 2023-07-29T17:09:28.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_expire_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_replay_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_link_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_mdstable_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_openc_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_rename_at": "0", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_events_per_segment": "1024", 2023-07-29T17:09:28.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_events": "-1", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_segments": "128", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_pause": "false", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_segment_size": "0", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_skip_corrupt_events": "false", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_warn_factor": "2.000000", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_caps_per_client": "1048576", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_flushes": "100000", 2023-07-29T17:09:28.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_requests": "100000", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_export_size": "20971520", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_file_recover": "32", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_files": "64", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops": "8192", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_snaps_per_dir": "100", 2023-07-29T17:09:28.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_xattr_pairs_size": "65536", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_metrics_update_interval": "2", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_per_client": "100", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_working_set": "10000", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_numa_node": "-1", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_complaint_time": "30.000000", 2023-07-29T17:09:28.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_duration": "600", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_size": "20", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_log_threshold": "5", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_grace": "15", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_interval": "5", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-07-29T17:09:28.488 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_caps": "30000", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_threshold": "131072", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_threshold": "262144", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_reconnect_timeout": "45.000000", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_interval": "1.000000", 2023-07-29T17:09:28.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_gid": "0", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_uid": "0", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_evict": "true", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_timeout": "true", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-07-29T17:09:28.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_shutdown_check": "0", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_skip_ino": "0", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sleep_rank_change": "0.000000", 2023-07-29T17:09:28.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_max_uid": "4294967294", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_min_uid": "0", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_rstat": "false", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_standby_replay_damaged": "false", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_symlink_recovery": "true", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_task_status_update_interval": "2.000000", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_exports": "0", 2023-07-29T17:09:28.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_fragments": "0", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_tick_interval": "5.000000", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_valgrind_exit": "false", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_backtrace": "1", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_scatter": "false", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_ino_prealloc": "false", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_sessions": "false", 2023-07-29T17:09:28.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool_debug": "false", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_debug_omit_block_device_write": "false", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_device_bytes": "1073741824", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_set": "false", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_size": "65536", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_bytes": "134217728", 2023-07-29T17:09:28.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_messages": "512", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_connect_retry_interval": "1.000000", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_disabled_modules": "", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-07-29T17:09:28.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_max_pg_num_change": "128", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_bytes": "134217728", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_messages": "128", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_bytes": "134217728", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_messages": "128", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_bytes": "536870912", 2023-07-29T17:09:28.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_messages": "8192", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_pool": "true", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_service_beacon_grace": "60.000000", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_standby_modules": "true", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_period": "5", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_threshold": "5", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_tick_period": "2", 2023-07-29T17:09:28.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_accept_timeout_factor": "2.000000", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_delete": "true", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_size_one": "true", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_auth_validate_all_caps": "true", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-07-29T17:09:28.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_bytes": "104857600", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_directed_command_retry": "2", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval": "3.000000", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_parallel": "3", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_log_interval": "1.000000", 2023-07-29T17:09:28.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_interval": "10.000000", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_timeout": "30.000000", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_allowed": "1.000000", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-07-29T17:09:28.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file_level": "debug", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_file": "true", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog": "false", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_journald": "false", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_stderr": "false", 2023-07-29T17:09:28.501 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-07-29T17:09:28.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-07-29T17:09:28.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-07-29T17:09:28.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_bootstrap": "false", 2023-07-29T17:09:28.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_start": "false", 2023-07-29T17:09:28.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_trim": "true", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_persist_interval": "10", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_score_halflife": "43200", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_config_key_max_entry_size": "65536", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cpu_threads": "4", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_crush_min_required_version": "hammer", 2023-07-29T17:09:28.503 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_daemon_bytes": "419430400", 2023-07-29T17:09:28.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-07-29T17:09:28.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_crit": "5", 2023-07-29T17:09:28.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_warn": "5", 2023-07-29T17:09:28.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_size_warn": "16106127360", 2023-07-29T17:09:28.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_block_osdmap_trim": "false", 2023-07-29T17:09:28.505 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-07-29T17:09:28.505 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_json": "false", 2023-07-29T17:09:28.505 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-07-29T17:09:28.505 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_transactions": "false", 2023-07-29T17:09:28.506 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_extra_checks": "false", 2023-07-29T17:09:28.506 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-07-29T17:09:28.506 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-07-29T17:09:28.507 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_quincy": "false", 2023-07-29T17:09:28.507 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_reef": "false", 2023-07-29T17:09:28.507 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-07-29T17:09:28.507 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_delta_reset_interval": "10.000000", 2023-07-29T17:09:28.507 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_dns_srv_name": "ceph-mon", 2023-07-29T17:09:28.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_down_mkfs_grace": "120", 2023-07-29T17:09:28.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_default_strategy": "1", 2023-07-29T17:09:28.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_timeout": "5.000000", 2023-07-29T17:09:28.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-07-29T17:09:28.508 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_divisor": "2", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_timeout": "2.000000", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_enable_op_tracker": "true", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_fake_pool_delete": "false", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_force_quorum_join": "false", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_globalid_prealloc": "10000", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_detail_to_clog": "false", 2023-07-29T17:09:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_log_update_period": "5", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_max_detail": "50", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog": "true", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_interval": "600", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host": "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host_override": "", 2023-07-29T17:09:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_initial_members": "", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_keyvaluedb": "rocksdb", 2023-07-29T17:09:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease": "5.000000", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_full_interval": "50", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max": "10000", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max_summary": "50", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_entries_per_event": "4096", 2023-07-29T17:09:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_epochs": "500", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mdsmap_epochs": "500", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mgrmap_epochs": "500", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_osd": "10000", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pg_per_osd": "10000", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pool_pg_num": "65536", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-07-29T17:09:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_force_trim_to": "0", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_skip_sanity": "false", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_autotune": "true", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_target": "2147483648", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_beacon_grace": "30", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_digest_period": "5", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_inactive_grace": "60", 2023-07-29T17:09:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_mkfs_grace": "240", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_min_osdmap_epochs": "500", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_complaint_time": "30", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_duration": "600", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_size": "20", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_size": "20", 2023-07-29T17:09:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_threshold": "10", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_log_threshold": "5", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_in": "false", 2023-07-29T17:09:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_new_in": "true", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size": "500", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size_min": "134217728", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_crush_smoke_test": "true", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_destroyed_out_interval": "600", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_interval": "600", 2023-07-29T17:09:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-07-29T17:09:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-07-29T17:09:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_force_trim_to": "0", 2023-07-29T17:09:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_full_ratio": "0.950000", 2023-07-29T17:09:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-07-29T17:09:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_halflife": "3600", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_max_interval": "300", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_weight": "0.300000", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_creating_pgs": "1024", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_initial_pgs": "1024", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_down_reporters": "2", 2023-07-29T17:09:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp": "true", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_report_timeout": "900", 2023-07-29T17:09:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_num_repaired": "10", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_op_age": "32.000000", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_interval": "10", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_min": "10000", 2023-07-29T17:09:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_stuck_threshold": "60", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_objects": "10000", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_per_osd": "0", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-07-29T17:09:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_crit_threshold": "0", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_warn_threshold": "0", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_probe_timeout": "2.000000", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_change": "0.050000", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_osds": "4", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-07-29T17:09:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_interval": "86400", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_max_keys": "100", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_timeout": "300", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_session_timeout": "300", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_smart_report_timeout": "5", 2023-07-29T17:09:28.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stat_smooth_intervals": "6", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_min_size": "2", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_size": "4", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_subscribe_interval": "86400.000000", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_debug": "false", 2023-07-29T17:09:28.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_keys": "2000", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_size": "1048576", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_provider_kill_at": "0", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_requester_kill_at": "0", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_timeout": "60.000000", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_target_pg_per_osd": "100", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_tick_interval": "5", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_interval": "300.000000", 2023-07-29T17:09:28.526 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_use_min_delay_socket": "false", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_older_version_delay": "604800", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_filestore_osds": "false", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-07-29T17:09:28.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-07-29T17:09:28.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-07-29T17:09:28.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_misplaced": "false", 2023-07-29T17:09:28.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-07-29T17:09:28.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_older_version": "true", 2023-07-29T17:09:28.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_app": "true", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-07-29T17:09:28.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_too_few_osds": "false", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": "", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-07-29T17:09:28.530 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_tracing_enabled": "false", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_op_threads": "3", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_buffer_size": "131072", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_cm": "false", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_device_name": "", 2023-07-29T17:09:28.531 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_dscp": "96", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_gid_idx": "0", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_local_gid": "", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_polling_us": "1000", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_port_num": "1", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-07-29T17:09:28.532 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_roce_ver": "1", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_send_buffers": "1024", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_sl": "3", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_support_srq": "true", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_type": "ib", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_reap_threshold": "5", 2023-07-29T17:09:28.533 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_before_connect": "false", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv4": "true", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv6": "false", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr1": "true", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr2": "true", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_max": "7568", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_min": "6800", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_prefer_ipv4": "false", 2023-07-29T17:09:28.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_count": "3", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_delay": "5", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_client": "false", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mds": "false", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mgr": "false", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mon": "false", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_osd": "false", 2023-07-29T17:09:28.535 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_client_mode": "crc secure", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_mode": "crc secure", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_type": "", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_compress_secure": "false", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_idle_timeout": "900", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_ready_timeout": "10", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_data": "true", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_header": "true", 2023-07-29T17:09:28.536 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bad_msg": "false", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bug": "true", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_old_message": "true", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_skipped_message": "false", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_unhandled_msg": "false", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_coremask": "0xF", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-07-29T17:09:28.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_devs_allowlist": "", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_enable_tso": "true", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hugepages": "", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_flow_control": "true", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_lro": "true", 2023-07-29T17:09:28.538 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_memory_channel": "4", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_pmd": "", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_port_id": "0", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_corrupt_message_level": "1", 2023-07-29T17:09:28.539 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_on_send": "false", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_initial_backoff": "0.200000", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_max": "1.000000", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_probability": "0.000000", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_type": "", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_internal_delays": "0.000000", 2023-07-29T17:09:28.540 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_network_congestion": "0", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_socket_failures": "0", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_learn_addr_from_peer": "true", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_accept_failures": "4", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_backoff": "15.000000", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_client_mode": "secure crc", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_cluster_mode": "secure crc", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_service_mode": "secure crc", 2023-07-29T17:09:28.541 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_min_size": "1024", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_mode": "none", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compression_algorithm": "snappy", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_min_cost": "65536", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_public_type": "", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_service_mode": "crc secure", 2023-07-29T17:09:28.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_listen_backlog": "512", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_nodelay": "true", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_rcvbuf": "0", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_type": "async+posix", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "no_config_file": "false", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_completion_locks_per_session": "32", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_debug_inject_relock_delay": "false", 2023-07-29T17:09:28.543 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_op_bytes": "104857600", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_ops": "1024", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inject_no_watch_ping": "false", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_tick_interval": "5.000000", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_timeout": "10.000000", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "objectstore_blackhole": "false", 2023-07-29T17:09:28.544 INFO:teuthology.orchestra.run.smithi073.stdout: "openssl_engine_opts": "", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_delay_time": "5.000000", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_hist_halflife": "1000", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_low_ops": "2", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_ops": "4", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-07-29T17:09:28.545 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_quantize_effort": "0.100000", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_slop": "0.020000", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_allow_recovery_below_min_size": "true", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_asio_thread_count": "2", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_async_recovery_min_cost": "100", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_auto_mark_unfound_lost": "false", 2023-07-29T17:09:28.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_retry_interval": "30.000000", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_max": "512", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_min": "64", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_degraded": "false", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_peering": "false", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_unfound": "true", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_beacon_report_interval": "300", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_duration": "30", 2023-07-29T17:09:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_max_block_size": "67108864", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_small_size_max_iops": "100", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blkin_trace_all": "false", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blocked_scrub_grace_period": "120", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-07-29T17:09:28.548 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_for_log_corruption": "false", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_update_on_start": "true", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_cap": "256", 2023-07-29T17:09:28.549 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_size_cap": "524288000", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_op_priority": "63", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_watch_timeout": "30", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_command_max_records": "256", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_compact_on_start": "false", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_chooseleaf_type": "0", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_initial_weight": "-1.000000", 2023-07-29T17:09:28.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_on_start": "true", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_weight_set": "true", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_duration": "0", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-07-29T17:09:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_feed_pullee": "-1", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_misdirected_ops": "false", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_acting_change": "false", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_purge_strays": "false", 2023-07-29T17:09:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_op_order": "false", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pg_log_writeout": "false", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pretend_recovery_active": "false", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_shutdown": "false", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-07-29T17:09:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_cached_snaps": "false", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_missing_on_start": "false", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_snaps": "false", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_keys": "1024", 2023-07-29T17:09:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_stride": "524288", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_data_pool_replay_window": "5", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_notify_timeout": "30", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep": "0.000000", 2023-07-29T17:09:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_discard_disconnected_ops": "true", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_enable_op_tracker": "true", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_extblkdev_plugins": "vdo", 2023-07-29T17:09:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_info": "true", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown": "true", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_timeout": "15", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-07-29T17:09:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_function_tracing": "false", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_grace": "20", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_interval": "6", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_peers": "10", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_size": "2000", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_stale": "600", 2023-07-29T17:09:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_max_size": "100000", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_min_size": "1000", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-07-29T17:09:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_flush_on_shutdown": "true", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_size": "5120", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_kill_backfill_at": "0", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_loop_before_reset_tphandle": "64", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_cache_size": "50", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_dedup": "true", 2023-07-29T17:09:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max": "40", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max_bytes": "10485760", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_share_max_epochs": "40", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_name_len": "100", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_size": "0", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_backfills": "1", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_count": "5", 2023-07-29T17:09:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_period": "600", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_name_len": "2048", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_namespace_len": "256", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_size": "134217728", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_entries_per_request": "1024", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_blocked_by": "16", 2023-07-29T17:09:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_log_entries": "10000", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pgls": "1024", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_cost": "8388608", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_objects": "10", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_scrubs": "1", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-07-29T17:09:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_trimming_pgs": "2", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_op_reply_len": "64", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_size": "90", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-07-29T17:09:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_override_recovery_settings": "false", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_profile": "balanced", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-07-29T17:09:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-07-29T17:09:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-07-29T17:09:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_skip_benchmark": "false", 2023-07-29T17:09:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_base": "805306368", 2023-07-29T17:09:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_min": "134217728", 2023-07-29T17:09:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target": "4294967296", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_autotune": "false", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_pg_log_entries": "250", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_recovery_priority": "0", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_interval": "30", 2023-07-29T17:09:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_interval": "5", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_max_in_flight": "2", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_cache_shards": "32", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_op_tracker_shard": "32", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_auto_affinity": "true", 2023-07-29T17:09:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_node": "-1", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_prefer_iface": "true", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objecter_finishers": "1", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore": "bluestore", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_fuse": "false", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_tracing": "false", 2023-07-29T17:09:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_complaint_time": "30.000000", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_duration": "600", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_size": "20", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_size": "20", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_log_threshold": "5", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards": "0", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_hdd": "5", 2023-07-29T17:09:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_ssd": "8", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard": "0", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_min_cost": "65536", 2023-07-29T17:09:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue": "mclock_scheduler", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue_cut_off": "high", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_suicide_timeout": "150", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_timeout": "15", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_open_classes_on_start": "true", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_os_flags": "0", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_peering_op_priority": "255", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_cost": "1048576", 2023-07-29T17:09:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_priority": "5", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_dups_tracked": "3000", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_max": "10000", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_min": "100", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_object_context_cache_count": "64", 2023-07-29T17:09:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_stat_report_interval_max": "500", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-07-29T17:09:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crimson": "false", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crush_rule": "-1", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_ec_fast_read": "false", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_bulk": "false", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nodelete": "false", 2023-07-29T17:09:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flags": "0", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_min_size": "0", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_num": "32", 2023-07-29T17:09:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pgp_num": "0", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_size": "2", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_type": "replicated", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_use_gmt_hitset": "true", 2023-07-29T17:09:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_push_per_object_cost": "1000", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_read_ec_check_for_errors": "false", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap": "true", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap_limit": "10", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_cost": "20971520", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_delay_start": "0.000000", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active": "0", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_hdd": "3", 2023-07-29T17:09:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_ssd": "10", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_chunk": "8388608", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_single_start": "1", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_priority": "3", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_warn_multiple": "16", 2023-07-29T17:09:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_priority": "5", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_retry_interval": "30.000000", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep": "0.000000", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-07-29T17:09:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_repair_during_recovery": "false", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_requested_scrub_priority": "120", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rollback_to_cluster_snap": "", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair": "false", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-07-29T17:09:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_hour": "0", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_week_day": "0", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_max": "25", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_min": "5", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_cost": "52428800", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_during_recovery": "false", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_hour": "0", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_week_day": "0", 2023-07-29T17:09:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_event_cost": "4096", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_invalid_stats": "true", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_load_threshold": "0.500000", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_interval": "604800.000000", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_preemptions": "5", 2023-07-29T17:09:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_min_interval": "86400.000000", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_priority": "5", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_reservation_timeout": "5000", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_sleep": "0.000000", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-07-29T17:09:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shutdown_pgref_assert": "false", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_skip_data_digest": "false", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_smart_report_timeout": "5", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_cost": "1048576", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_priority": "5", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep": "0.000000", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-07-29T17:09:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_scrubbing": "15", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_transaction_size": "30", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-07-29T17:09:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_mode": "writeback", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-07-29T17:09:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tracing": "false", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_use_stale_snap": "false", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "osdc_blkin_trace_all": "false", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_kill_at": "0", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_max_join_drift": "10", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min": "500", 2023-07-29T17:09:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min_wait": "0.050000", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_propose_interval": "1.000000", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max": "500", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max_multiplier": "20", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_min": "250", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_stash_full_interval": "25", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_max": "500", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_min": "250", 2023-07-29T17:09:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "perf": "true", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "-", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrv": "", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_bind_addr": "-", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network": "", 2023-07-29T17:09:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network_interface": "", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_enabled": "false", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_session_max_number": "256", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_mon_op_timeout": "0", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_osd_op_timeout": "0", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_tracing": "false", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_atime_update_interval": "60", 2023-07-29T17:09:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_parent_reads": "false", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_snap_reads": "false", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blkin_trace_all": "false", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_expire_seconds": "0", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_on_break_lock": "true", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache": "true", 2023-07-29T17:09:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_block_writes_upfront": "false", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty": "25165824", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_object": "0", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_policy": "writearound", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_size": "33554432", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_target_dirty": "16777216", 2023-07-29T17:09:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_clone_copy_on_read": "false", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_compression_hint": "none", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_concurrent_management_ops": "10", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_clone_format": "auto", 2023-07-29T17:09:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_data_pool": "", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_features": "61", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_format": "2", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_map_options": "", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_order": "22", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_pool": "rbd", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-07-29T17:09:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_count": "0", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_unit": "0", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_disable_zero_copy_writes": "true", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_granularity_bytes": "65536", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_enable_alloc_hint": "true", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-07-29T17:09:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler": "simple", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_commit_age": "5.000000", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-07-29T17:09:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_interval": "0", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_order": "24", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_pool": "", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_splay_width": "4", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_parent_reads": "false", 2023-07-29T17:09:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_snap_reads": "false", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-07-29T17:09:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_type": "simple", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-07-29T17:09:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_autotune": "true", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_base": "805306368", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-07-29T17:09:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_target": "4294967296", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_delete_delay": "0", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_replay_delay": "0", 2023-07-29T17:09:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove": "false", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mtime_update_interval": "60", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_non_blocking_aio": "true", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_thread_timeout": "60", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_threads": "1", 2023-07-29T17:09:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_parent_cache_enabled": "false", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_mode": "disabled", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_path": "/tmp", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_size": "1073741824", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_plugins": "", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst": "0", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-07-29T17:09:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_limit": "0", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_exclude_ops": "0", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst": "0", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_limit": "0", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst": "0", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-07-29T17:09:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_limit": "0", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst": "0", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_limit": "0", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_schedule_tick_min": "50", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst": "0", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_limit": "0", 2023-07-29T17:09:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst": "0", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_limit": "0", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_quiesce_notification_attempts": "10", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_read_from_replica_policy": "default", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_max_bytes": "524288", 2023-07-29T17:09:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_trigger_requests": "10", 2023-07-29T17:09:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_request_timed_out_seconds": "30", 2023-07-29T17:09:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_skip_partial_discard": "true", 2023-07-29T17:09:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-07-29T17:09:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_tracing": "false", 2023-07-29T17:09:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_names": "true", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_pool": "true", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_base_url": "", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_log_level": "", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_acl_grants_max_num": "100", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_admin_entry": "admin", 2023-07-29T17:09:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_backend_store": "rados", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_barbican_url": "", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_beast_enable_async": "true", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-07-29T17:09:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_max_aio": "128", 2023-07-29T17:09:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-07-29T17:09:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-07-29T17:09:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_ttl": "600", 2023-07-29T17:09:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-07-29T17:09:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_enabled": "true", 2023-07-29T17:09:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_expiry_interval": "900", 2023-07-29T17:09:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_lru_size": "10000", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_config_store": "rados", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_content_length_compat": "false", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress": "true", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cors_rules_max_num": "100", 2023-07-29T17:09:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cross_domain_policy": "", 2023-07-29T17:09:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_default_encryption_key": "", 2023-07-29T17:09:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_addr": "", 2023-07-29T17:09:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_ca_path": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_cert": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_key": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_password": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_username": "", 2023-07-29T17:09:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_require_ssl": "true", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-07-29T17:09:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-07-29T17:09:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_suppress_logs": "true", 2023-07-29T17:09:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_addr": "", 2023-07-29T17:09:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_auth": "token", 2023-07-29T17:09:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_namespace": "", 2023-07-29T17:09:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_prefix": "", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_token_file": "", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-07-29T17:09:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_buffersize": "524288", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_limit": "1024", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_time": "300", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_tcp_keepalive": "0", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-07-29T17:09:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_fadvise": "4", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_changes_size": "1000", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_num_shards": "128", 2023-07-29T17:09:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_window": "30", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_notify_interval_msec": "0", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_poll_interval": "20", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_spawn_window": "20", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-07-29T17:09:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_data_log_backing": "fifo", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_region_info_oid": "default.region", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_defer_to_bucket_acls": "", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-07-29T17:09:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_res": "500.000000", 2023-07-29T17:09:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_name": "", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_s3website_name": "", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding": "true", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-07-29T17:09:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_gc_threads": "true", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_lc_threads": "true", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_ops_log": "false", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_quota_threads": "true", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_static_website": "false", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_usage_log": "false", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enforce_swift_acls": "true", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_exit_timeout_secs": "120", 2023-07-29T17:09:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_expose_bucket": "false", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_extended_http_attrs": "", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_filter": "none", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontends": "beast port=7480", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_concurrent_io": "10", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred": "50", 2023-07-29T17:09:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_objs": "32", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_queue_size": "134213632", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_trim_chunk": "16", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_obj_min_wait": "7200", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_max_time": "3600", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_period": "3600", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-07-29T17:09:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_window_size": "16777216", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_healthcheck_disabling_path": "", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ignore_get_invalid_range": "false", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_init_timeout": "300", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-07-29T17:09:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_domain": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password_path": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_project": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_tenant": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token_path": "", 2023-07-29T17:09:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_user": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_api_version": "2", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_domain": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_password": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_project": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_tenant": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_user": "", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-07-29T17:09:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_implicit_tenants": "false", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_enabled": "false", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_token_cache_size": "10000", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_url": "", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_verify_ssl": "true", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_debug_interval": "-1", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_lock_max_time": "90", 2023-07-29T17:09:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_objs": "32", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_rules": "1000", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_worker": "3", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_wp_worker": "3", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_thread_delay": "0", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_dnattr": "uid", 2023-07-29T17:09:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchfilter": "", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_uri": "ldaps://", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_http_headers": "", 2023-07-29T17:09:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_nonexistent_bucket": "false", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name_utc": "false", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_name_len": "0", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_size": "0", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attrs_num_in_req": "0", 2023-07-29T17:09:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_chunk_size": "4194304", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_concurrent_requests": "1024", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_dynamic_shards": "1999", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_listing_results": "1000", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_notify_retries": "3", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_objs_per_shard": "100000", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_param_size": "1048576", 2023-07-29T17:09:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_size": "5368709120", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_slo_entries": "1000", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_log_max_shards": "64", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_notify_interval_msec": "200", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_poll_interval": "20", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_spawn_window": "20", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mp_lock_max_time": "600", 2023-07-29T17:09:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_min_part_size": "5242880", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_size": "2017", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lanes": "5", 2023-07-29T17:09:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_max_gc": "300", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_gc_threads": "false", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_lc_threads": "false", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_quota_threads": "false", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_sync_thread": "false", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-07-29T17:09:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_async_rados_threads": "32", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_control_oids": "8", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_numa_node": "-1", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_stripe_size": "4194304", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_chunk_size": "100", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_gc_interval": "600", 2023-07-29T17:09:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_hints_num_shards": "127", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_timeout": "600", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_tracing": "false", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_token": "", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_url": "", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_verify_ssl": "true", 2023-07-29T17:09:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_rados": "false", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_socket_path": "", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval": "2.000000", 2023-07-29T17:09:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval_max": "30.000000", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_root_pool": ".rgw.root", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_continue": "true", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_prohibited_content_length": "false", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-07-29T17:09:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_tracing": "false", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm": "", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_id": "", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region": "", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region_root_pool": ".rgw.root", 2023-07-29T17:09:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_region_enforcement": "false", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_request_uri": "", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_batch_size": "64", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_max_aio": "128", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_num_logs": "16", 2023-07-29T17:09:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_thread_interval": "600", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_resolve_cname": "false", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rest_getusage_op_compat": "false", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_run_sync_thread": "true", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_keystone": "false", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_ldap": "false", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_rados": "true", 2023-07-29T17:09:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_sts": "false", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_success_create_obj_status": "0", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_scheduler_type": "throttler", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_script_uri": "", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_service_provider_name": "", 2023-07-29T17:09:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_id": "", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_secret": "", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_entry": "sts", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_key": "sts", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_max_session_duration": "43200", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_min_session_duration": "900", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_token_introspection_url": "", 2023-07-29T17:09:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_account_in_url": "false", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_entry": "auth", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_url": "", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_custom_header": "", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_enforce_content_length": "false", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_need_stats": "true", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_tenant_name": "", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_token_expiration": "86400", 2023-07-29T17:09:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url": "", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url_prefix": "swift", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_versioning_enabled": "false", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_lease_period": "120", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_interval": "1200", 2023-07-29T17:09:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_obj_etag_verify": "false", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_history_size": "4096", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-07-29T17:09:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_thread_pool_size": "512", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_comment": "", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_createby": "", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_encoding": "", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_flag": "false", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_origin": "", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_sha_unit": "524288", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_tracker": "", 2023-07-29T17:09:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_trust_forwarded_https": "false", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_tick_interval": "30", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_shards": "32", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_user_shards": "1", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_use_opa_authz": "false", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_size": "-1", 2023-07-29T17:09:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_max_buckets": "1000", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_policies_max_num": "100", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_interval": "86400", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_unique_email": "true", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_verify_ssl": "true", 2023-07-29T17:09:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_website_routing_rules_max_num": "50", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone": "", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_id": "", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup": "", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_id": "", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-07-29T17:09:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_auto_session_clear": "true", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_skip_bucket_step": "false", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_block_size": "4096", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_shard_bits": "4", 2023-07-29T17:09:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_size": "536870912", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_type": "binned_lru", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_compaction_stats": "false", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_extended_stats": "false", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_memory_stats": "false", 2023-07-29T17:09:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_index_type": "binary_search", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_log_to_ceph_log": "true", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_metadata_block_size": "4096", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_partition_filters": "false", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_perf": "false", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-07-29T17:09:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_renewal_timeout": "10", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "run_dir": "/var/run/ceph", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_block_create": "true", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cache_lru_size": "67108864", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cbjournal_size": "5368709120", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_max_object_size": "16777216", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-07-29T17:09:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_device_size": "53687091200", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_capacity": "16", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_iodepth_limit": "5", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_main_device_type": "SSD", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_max_concurrent_transactions": "8", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-07-29T17:09:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_segment_size": "67108864", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "set_keepcaps": "false", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "setgroup": "", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser": "", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser_match_path": "", 2023-07-29T17:09:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_misplaced_ratio": "0.050000", 2023-07-29T17:09:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "thp": "false", 2023-07-29T17:09:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_default_timeout": "60", 2023-07-29T17:09:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_empty_queue_max_wait": "2", 2023-07-29T17:09:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "throttler_perf_counter": "true" 2023-07-29T17:09:28.663 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-07-29T17:09:28.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-07-29T17:09:28.800 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2023-07-29T17:09:28.809 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2023-07-29T17:09:28.819 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2023-07-29T17:09:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T17:09:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T17:09:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T17:09:28.831 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-07-29T17:09:28.831 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-29T17:09:28.859 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-29T17:09:28.859 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-07-29T17:09:28.859 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-29T17:09:28.860 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-29T17:09:28.860 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:28.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:28.861 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-29T17:09:28.861 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-07-29T17:09:28.862 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T17:09:28.862 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T17:09:28.862 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-07-29T17:09:28.862 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-07-29T17:09:28.862 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-07-29T17:09:28.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-07-29T17:09:28.863 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-07-29T17:09:28.864 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-07-29T17:09:28.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T17:09:28.864 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-07-29T17:09:28.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:28.865 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-07-29T17:09:28.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T17:09:28.867 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:28.852+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:28.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:28.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-29T17:09:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-07-29T17:09:28.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:09:28.958 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-29T17:09:28.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-29T17:09:28.965 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:28.952+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.011 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:29.012 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-07-29T17:09:29.012 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:29.013 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:29.013 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:29.013 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:29.013 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:29.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:29.066 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:29.053+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.166 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:29.154+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.192 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:29.192 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:29.192 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:29.192 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:29.192 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:29.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:29.267 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:29.255+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:29.330 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:29.330 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.513608944000001, 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:29.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:29.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:29.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:29.337 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:29.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.513565204999999, 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:29.344 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.345 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:29.346 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.347 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.513466299000001, 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:29.348 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.349 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.350 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.351 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.352 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:29.353 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.512913493999999, 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.356 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:29.357 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.358 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:29.359 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.360 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:29.361 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.362 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.512180455999999, 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:29.364 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:29.366 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.367 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.368 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:29.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.370 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.371 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511200166999998, 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.373 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:29.374 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.376 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:29.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:29.378 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.380 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.381 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511162928000001, 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:29.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.384 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:29.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.386 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.388 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:29.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.391 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511137659999999, 2023-07-29T17:09:29.392 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.394 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.395 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:29.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.397 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:29.398 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:29.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.399 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.399 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.399 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:29.399 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:29.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.401 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.401 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:29.401 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:29.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.402 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.402 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.402 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:29.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:29.403 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.404 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.404 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.404 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.405 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:29.405 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511119108999999, 2023-07-29T17:09:29.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:29.405 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.406 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.406 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.406 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:29.407 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.407 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.408 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:29.408 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.408 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.409 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:29.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.410 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.410 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:29.410 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:29.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.411 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.411 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:29.411 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:29.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.412 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.412 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:29.412 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:29.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.413 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.413 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.413 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:29.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:29.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.415 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.417 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:29.417 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:29.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.418 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.418 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:29.418 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:29.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.419 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.419 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:29.420 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:29.420 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.420 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.420 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.421 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.422 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:29.422 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511107894999999, 2023-07-29T17:09:29.422 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:29.422 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.422 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.423 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:29.424 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.425 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.427 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:29.428 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.429 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.430 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:29.431 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:29.432 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511096698999999, 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:29.433 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.435 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.436 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:29.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.439 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.440 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511078282, 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.444 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.446 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:29.447 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.448 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511050681, 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.451 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:29.452 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:29.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:29.456 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.511030285, 2023-07-29T17:09:29.457 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.459 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:29.460 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:29.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.463 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.505495793000001, 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.467 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:29.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:29.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.469 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.469 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.469 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:29.469 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:29.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.471 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.472 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.473 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.503044287000002, 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.474 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:29.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.478 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.503013688999999, 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:29.484 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.485 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.488 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.488 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:29.488 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:29.488 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.488 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.502992070000001, 2023-07-29T17:09:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:29.490 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.491 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.492 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.494 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.495 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 20.501843324999999, 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:29.497 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.498 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:29.499 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.500 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.501 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.501 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:29.501 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:29.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.501 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.502 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:29.503 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:29.504 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 15.820176839, 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:29.505 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:29.507 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.508 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:29.509 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.510 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:29.511 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:29.514 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:29.516 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:29.503+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.516 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-29T17:09:29.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:29.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-29T17:09:29.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-29T17:09:29.518 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-07-29T17:09:29.518 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-29T17:09:29.518 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:29.518 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-29T17:09:29.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-29T17:09:29.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-29T17:09:29.519 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-29T17:09:29.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:29.520 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-07-29T17:09:29.538 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-29T17:09:29.538 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-29T17:09:29.538 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-07-29T17:09:29.539 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-29T17:09:29.540 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42041sec preferred_lft 42041sec 2023-07-29T17:09:29.541 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-07-29T17:09:29.541 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-07-29T17:09:29.541 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-29T17:09:29.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:29.542 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-29T17:09:29.542 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-29T17:09:29.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-07-29T17:09:29.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-07-29T17:09:29.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-07-29T17:09:29.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-29T17:09:29.543 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-29T17:09:29.616 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:29.604+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:29.663 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:29.664 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:29.664 INFO:teuthology.orchestra.run.smithi093.stdout: "num_ops": 0 2023-07-29T17:09:29.664 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:29.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:29.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:29.712 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-29T17:09:29.717 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:29.705+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:29.744 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-07-29T17:09:29.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:29.745 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-07-29T17:09:29.800 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:29.801 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:29.801 INFO:teuthology.orchestra.run.smithi093.stdout: "complaint_time": 30, 2023-07-29T17:09:29.801 INFO:teuthology.orchestra.run.smithi093.stdout: "num_blocked_ops": 0 2023-07-29T17:09:29.801 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:29.810 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:29.830 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-07-29T17:09:29.830 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-29T17:09:29.830 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-29T17:09:29.831 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-29T17:09:29.831 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-29T17:09:29.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:29.832 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-29T17:09:29.833 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-29T17:09:29.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-29T17:09:29.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-29T17:09:29.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-29T17:09:29.834 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-29T17:09:29.855 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:29.842+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.919 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:29.906+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:29.939 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:29.940 INFO:teuthology.orchestra.run.smithi093.stdout: "size": 20, 2023-07-29T17:09:29.940 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 600, 2023-07-29T17:09:29.940 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [ 2023-07-29T17:09:29.940 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.940 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.344803949999999, 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012704160000000001, 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:29.941 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 116 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:29.942 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.943 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:29.944 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580935+0000", 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.649e-06 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580939+0000", 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.658e-06 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.945 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580942+0000", 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7199999999999998e-06 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:29.946 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588048+0000", 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.007105971 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588097+0000", 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9279e-05 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.947 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588183+0000", 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6169999999999997e-05 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:29.948 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589060+0000", 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00087682500000000002 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593496+0000", 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0044364740000000001 2023-07-29T17:09:29.949 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593579+0000", 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2255000000000004e-05 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:29.950 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593637+0000", 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.8615e-05 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.951 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:29.952 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:29.952 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.344792614999999, 2023-07-29T17:09:29.952 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012802693, 2023-07-29T17:09:29.952 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:29.952 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 117 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:29.953 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:29.954 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.955 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580947+0000", 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:29.956 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580952+0000", 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.0209999999999999e-06 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580955+0000", 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7750000000000001e-06 2023-07-29T17:09:29.957 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588443+0000", 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0074877240000000003 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:29.958 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588533+0000", 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.0561000000000002e-05 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588628+0000", 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.4355e-05 2023-07-29T17:09:29.959 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589944+0000", 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001316401 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.960 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593693+0000", 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0037494529999999998 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593726+0000", 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2359e-05 2023-07-29T17:09:29.961 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593747+0000", 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.1364000000000001e-05 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.962 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.243170761999998, 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010198067999999999, 2023-07-29T17:09:29.963 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 137 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.964 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.965 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.966 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682611+0000", 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5226999999999999e-05 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.967 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682617+0000", 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9599999999999997e-06 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.968 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682623+0000", 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4210000000000003e-06 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686489+0000", 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038660999999999999 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.969 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686535+0000", 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6050999999999997e-05 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.970 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686606+0000", 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.1687000000000007e-05 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688623+0000", 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0020160569999999999 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.971 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692722+0000", 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0040992190000000003 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.972 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692744+0000", 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2586e-05 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692764+0000", 2023-07-29T17:09:29.973 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0035e-05 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:29.974 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.243110789999999, 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010220088, 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:29.975 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 138 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:29.976 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.977 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682628+0000", 2023-07-29T17:09:29.978 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0959999999999999e-06 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682632+0000", 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0280000000000002e-06 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.979 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682636+0000", 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.613e-06 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686959+0000", 2023-07-29T17:09:29.980 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043234190000000002 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687005+0000", 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5695000000000002e-05 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.981 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687082+0000", 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.6922000000000007e-05 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688629+0000", 2023-07-29T17:09:29.982 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0015476050000000001 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692797+0000", 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0041680859999999997 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.983 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692825+0000", 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7928000000000001e-05 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692846+0000", 2023-07-29T17:09:29.984 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0985e-05 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:29.985 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.243098534000001, 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010277467, 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:29.986 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:29.987 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 139 2023-07-29T17:09:29.987 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.987 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:29.987 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.988 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682638+0000", 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:29.989 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682641+0000", 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6460000000000002e-06 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:29.990 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682645+0000", 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9840000000000003e-06 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682648+0000", 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6060000000000001e-06 2023-07-29T17:09:29.991 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.992 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.992 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:29.992 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687316+0000", 2023-07-29T17:09:29.992 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0046686189999999997 2023-07-29T17:09:29.992 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.993 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.993 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:29.993 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687368+0000", 2023-07-29T17:09:29.993 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2145999999999998e-05 2023-07-29T17:09:29.994 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.994 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.994 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:29.994 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687439+0000", 2023-07-29T17:09:29.995 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0261999999999999e-05 2023-07-29T17:09:29.995 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.995 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.996 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:29.996 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688635+0000", 2023-07-29T17:09:29.996 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0011961859999999999 2023-07-29T17:09:29.996 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.997 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.997 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:29.997 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692867+0000", 2023-07-29T17:09:29.997 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0042322319999999998 2023-07-29T17:09:29.998 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.998 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.998 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:29.998 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692895+0000", 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.8416999999999999e-05 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692916+0000", 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0602999999999999e-05 2023-07-29T17:09:29.999 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:30.000 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.243082681000001, 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010365035999999999, 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:30.001 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 140 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.002 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.003 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682700+0000", 2023-07-29T17:09:30.004 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6201e-05 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682705+0000", 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3669999999999999e-06 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.005 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682708+0000", 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.006 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687669+0000", 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0049609889999999999 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687717+0000", 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.8364e-05 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.007 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.008 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.008 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687791+0000", 2023-07-29T17:09:30.008 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3783999999999997e-05 2023-07-29T17:09:30.008 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.008 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688641+0000", 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00085023200000000003 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.009 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692974+0000", 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043330160000000003 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693000+0000", 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6179000000000001e-05 2023-07-29T17:09:30.010 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693019+0000", 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.9326000000000001e-05 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.011 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 31.243026222000001, 2023-07-29T17:09:30.012 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010373451000000001, 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 141 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.013 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.014 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.015 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682714+0000", 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6260000000000001e-06 2023-07-29T17:09:30.016 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682717+0000", 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2490000000000001e-06 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.017 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682720+0000", 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5019999999999999e-06 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688243+0000", 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055235320000000003 2023-07-29T17:09:30.018 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688298+0000", 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4863e-05 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.019 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688378+0000", 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9877999999999997e-05 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.689466+0000", 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0010876250000000001 2023-07-29T17:09:30.020 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693041+0000", 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0035748099999999999 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.021 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693066+0000", 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5592000000000002e-05 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693084+0000", 2023-07-29T17:09:30.022 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8051999999999999e-05 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:30.023 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.127544375999999, 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01054736, 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.024 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.025 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798191+0000", 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.026 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798200+0000", 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.3890000000000005e-06 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798441+0000", 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00024168400000000001 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.027 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798460+0000", 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8791e-05 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.028 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800079+0000", 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001618436 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800239+0000", 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000160051 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.029 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800394+0000", 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000155847 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.807144+0000", 2023-07-29T17:09:30.030 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067495480000000002 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808238+0000", 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001094308 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.031 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808284+0000", 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5327000000000002e-05 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808740+0000", 2023-07-29T17:09:30.032 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000456398 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.033 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.126641585000002, 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012771879999999999, 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.034 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.035 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799095+0000", 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.036 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799101+0000", 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6510000000000004e-06 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799115+0000", 2023-07-29T17:09:30.037 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.3427e-05 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799123+0000", 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2199999999999992e-06 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.038 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804445+0000", 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053221850000000001 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804551+0000", 2023-07-29T17:09:30.039 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000106205 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804694+0000", 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0001428 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811719+0000", 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0070253709999999999 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811784+0000", 2023-07-29T17:09:30.041 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.4465e-05 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811827+0000", 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3235000000000002e-05 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.042 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811867+0000", 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0238999999999999e-05 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.043 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.126603915, 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.014863889, 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.044 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.045 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.046 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799137+0000", 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799147+0000", 2023-07-29T17:09:30.047 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.9599999999999995e-06 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4793999999999997e-05 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.048 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805488+0000", 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0062865489999999998 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.049 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806468+0000", 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00097922599999999992 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806765+0000", 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00029750499999999999 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.050 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813753+0000", 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0069874689999999996 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.051 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813893+0000", 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000140226 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813938+0000", 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.4642999999999999e-05 2023-07-29T17:09:30.052 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813997+0000", 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9506999999999998e-05 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.053 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.126497715999999, 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015133384999999999, 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.054 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.055 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799238+0000", 2023-07-29T17:09:30.056 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799246+0000", 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3470000000000001e-06 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.057 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799257+0000", 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1331999999999999e-05 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799266+0000", 2023-07-29T17:09:30.058 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.7180000000000002e-06 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810513+0000", 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011246920000000001 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.059 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810627+0000", 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000114282 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811304+0000", 2023-07-29T17:09:30.060 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067641100000000003 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814140+0000", 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.002836281 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.061 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814300+0000", 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00016066 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814336+0000", 2023-07-29T17:09:30.062 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5805e-05 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814373+0000", 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6508999999999999e-05 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.063 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.126154536000001, 2023-07-29T17:09:30.064 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015275607, 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:30.065 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.066 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799582+0000", 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.067 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799588+0000", 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6590000000000004e-06 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799597+0000", 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.6649999999999998e-06 2023-07-29T17:09:30.068 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799605+0000", 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1170000000000004e-06 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.069 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812036+0000", 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430636 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812463+0000", 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00042748299999999999 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.070 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812602+0000", 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00013831499999999999 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.071 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001908893 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814800+0000", 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00028917999999999999 2023-07-29T17:09:30.072 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814836+0000", 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5948999999999998e-05 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.073 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814858+0000", 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2390000000000001e-05 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.074 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:16 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.126094164000001, 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010747720000000001, 2023-07-29T17:09:30.075 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.076 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.076 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.076 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.076 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.077 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:30.077 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.077 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.078 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.078 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.078 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:30.078 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.079 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.079 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.079 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.079 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799642+0000", 2023-07-29T17:09:30.080 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.080 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.080 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.081 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.081 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799646+0000", 2023-07-29T17:09:30.081 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9620000000000004e-06 2023-07-29T17:09:30.081 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.081 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799654+0000", 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.199e-06 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.082 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799661+0000", 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.9530000000000002e-06 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800044+0000", 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000383046 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.083 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800233+0000", 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018905699999999999 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:30.084 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800418+0000", 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018494099999999999 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806466+0000", 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0060481170000000004 2023-07-29T17:09:30.085 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810286+0000", 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038198450000000001 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.086 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810348+0000", 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2062000000000003e-05 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810391+0000", 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3031000000000002e-05 2023-07-29T17:09:30.087 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:30.088 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125887657, 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015461856, 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.089 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.090 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.091 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.092 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799855+0000", 2023-07-29T17:09:30.092 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8020000000000003e-06 2023-07-29T17:09:30.092 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.092 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.092 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799865+0000", 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.628e-06 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799873+0000", 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1480000000000006e-06 2023-07-29T17:09:30.093 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812921+0000", 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013048110999999999 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.094 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813008+0000", 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6581000000000003e-05 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813143+0000", 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000135258 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.095 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814890+0000", 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001747293 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.096 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815225+0000", 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000334648 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815268+0000", 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.097 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815311+0000", 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3349000000000001e-05 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125761533999999, 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010570684, 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.099 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.100 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799975+0000", 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.101 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799979+0000", 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.7419999999999999e-06 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.102 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799986+0000", 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2710000000000003e-06 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799993+0000", 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2150000000000004e-06 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.103 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802486+0000", 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0024926330000000002 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.104 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802589+0000", 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000103041 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802782+0000", 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00019310599999999999 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.105 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808103+0000", 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053207870000000004 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.106 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810437+0000", 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0023346930000000001 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810480+0000", 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.107 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810546+0000", 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6005000000000002e-05 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.108 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125730371, 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011747502, 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.109 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.110 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800006+0000", 2023-07-29T17:09:30.111 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800017+0000", 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1147e-05 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.112 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800025+0000", 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.8329999999999994e-06 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800033+0000", 2023-07-29T17:09:30.113 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9100000000000005e-06 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800215+0000", 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018224800000000001 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.114 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800360+0000", 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000144676 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800811+0000", 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000451457 2023-07-29T17:09:30.115 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055944840000000003 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.116 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811663+0000", 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052574379999999997 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811713+0000", 2023-07-29T17:09:30.117 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9375000000000001e-05 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811754+0000", 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1445e-05 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.118 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125690466000002, 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01314661, 2023-07-29T17:09:30.119 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.120 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.121 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800046+0000", 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800051+0000", 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5979999999999999e-06 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.122 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800060+0000", 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.482e-06 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.123 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800067+0000", 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0430000000000002e-06 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802741+0000", 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0026741289999999999 2023-07-29T17:09:30.124 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802884+0000", 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014245699999999999 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.125 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.803031+0000", 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014711699999999999 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808271+0000", 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052402430000000003 2023-07-29T17:09:30.126 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813100+0000", 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0048288360000000004 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.127 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813152+0000", 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.1560000000000001e-05 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813193+0000", 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1690000000000002e-05 2023-07-29T17:09:30.128 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:30.129 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125598693000001, 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013580643, 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:30.130 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.131 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.132 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800148+0000", 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.0010000000000001e-05 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800154+0000", 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.1680000000000001e-06 2023-07-29T17:09:30.133 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800158+0000", 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1110000000000001e-06 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.134 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804064+0000", 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0039061370000000001 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804183+0000", 2023-07-29T17:09:30.135 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00011890100000000001 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804326+0000", 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014277300000000001 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.136 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811446+0000", 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0071207800000000002 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.137 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813290+0000", 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0018438899999999999 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813347+0000", 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6555999999999999e-05 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.138 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813719+0000", 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000372142 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.139 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125555554000002, 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430045000000001, 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.140 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.141 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800181+0000", 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.142 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800185+0000", 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1659999999999996e-06 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.143 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800192+0000", 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2339999999999997e-06 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800199+0000", 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.7950000000000002e-06 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.144 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801571+0000", 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001372201 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.145 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801715+0000", 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014396499999999999 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802391+0000", 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067586000000000002 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.146 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.809114+0000", 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067226910000000003 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812051+0000", 2023-07-29T17:09:30.147 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0029367920000000001 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812103+0000", 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2806000000000002e-05 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.148 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812612+0000", 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00050817099999999997 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.149 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 21.125476387999999, 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013634713999999999, 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "started", 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:30.150 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:30.151 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800260+0000", 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.152 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800264+0000", 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6040000000000001e-06 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.153 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800270+0000", 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2820000000000002e-06 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800277+0000", 2023-07-29T17:09:30.154 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8800000000000002e-06 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805286+0000", 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0050090320000000001 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.155 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805474+0000", 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018839799999999999 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813895+0000", 2023-07-29T17:09:30.156 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0084212560000000002 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:30.157 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:30.158 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:30.146+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:30.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.160 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-29T17:09:30.160 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:30.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.181 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-07-29T17:09:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2023-07-29T17:09:30.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.202 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-29T17:09:30.202 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-29T17:09:30.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-29T17:09:30.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-29T17:09:30.202 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-29T17:09:30.259 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:30.246+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:30.296 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-29T17:09:30.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.297 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-29T17:09:30.297 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-29T17:09:30.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-29T17:09:30.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-29T17:09:30.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-29T17:09:30.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-29T17:09:30.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-29T17:09:30.299 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-29T17:09:30.304 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:30.304 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:30.304 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:30.305 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:30.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:30.398 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:30.386+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:30.460 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:30.448+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:30.483 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:30.483 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:30.483 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:30.484 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:30.484 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:30.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:30.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.503 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-07-29T17:09:30.503 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-07-29T17:09:30.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-07-29T17:09:30.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-07-29T17:09:30.504 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-07-29T17:09:30.560 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:30.548+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:30.602 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-29T17:09:30.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T17:09:30.603 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:30.620 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-29T17:09:30.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T17:09:30.621 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:30.661 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:30.649+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:30.663 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:30.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.179336892999999, 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:30.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:30.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.964951077999999, 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:30.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:30.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.963395557999998, 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:30.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:30.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:30.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.962903273999999, 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:30.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:30.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:30.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.962546443000001, 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:30.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.962111929999999, 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:30.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.851768816, 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:30.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:30.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.851315913000001, 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:30.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:30.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:30.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850885888000001, 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:30.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:30.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:30.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:30.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850841109000001, 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:30.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:30.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:30.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:30.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.749 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850813958, 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.750 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:30.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850789383999999, 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:30.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:30.768 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.85077588, 2023-07-29T17:09:30.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:30.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:30.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850755809999999, 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:30.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:30.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.850541836000001, 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:30.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:30.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:30.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.844144245999999, 2023-07-29T17:09:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:30.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:30.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.843762554000001, 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:30.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.843739854999999, 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:30.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:30.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.843477554, 2023-07-29T17:09:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:30.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:30.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.822 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.843378227999999, 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:30.823 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:30.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:30.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:30.829 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:30.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-07-29T17:09:30.832 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:30.818+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:30.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:30.900 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-29T17:09:30.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-29T17:09:30.932 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:30.920+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:30.966 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-29T17:09:30.967 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T17:09:30.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:30.968 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-07-29T17:09:30.979 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:30.980 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:30.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:31.025 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-29T17:09:31.025 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-29T17:09:31.033 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:31.021+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:31.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-07-29T17:09:31.093 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-29T17:09:31.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-29T17:09:31.118 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:31.118 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:31.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:31.134 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:31.121+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:31.152 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2023-07-29T17:09:31.140+0000 7fdba37b35c0 -1 init, newargv = 0x56004816c350 newargc=15 2023-07-29T17:09:31.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[113917]: starting ceph client 2023-07-29T17:09:31.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[113917]: starting fuse 2023-07-29T17:09:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-29T17:09:31.162 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T17:09:31.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:31.163 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-07-29T17:09:31.220 INFO:teuthology.orchestra.run.smithi073.stdout:46 2023-07-29T17:09:31.220 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-07-29T17:09:31.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-29T17:09:31.221 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2023-07-29T17:09:31.221 DEBUG:teuthology.orchestra.run.smithi073:> import re 2023-07-29T17:09:31.222 DEBUG:teuthology.orchestra.run.smithi073:> import os 2023-07-29T17:09:31.222 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2023-07-29T17:09:31.222 DEBUG:teuthology.orchestra.run.smithi073:> 2023-07-29T17:09:31.222 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2023-07-29T17:09:31.222 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-29T17:09:31.223 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2023-07-29T17:09:31.223 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-29T17:09:31.223 DEBUG:teuthology.orchestra.run.smithi073:> 2023-07-29T17:09:31.223 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2023-07-29T17:09:31.224 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2023-07-29T17:09:31.224 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2023-07-29T17:09:31.224 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2023-07-29T17:09:31.224 DEBUG:teuthology.orchestra.run.smithi073:> 2023-07-29T17:09:31.224 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2023-07-29T17:09:31.225 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-29T17:09:31.225 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-29T17:09:31.225 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-29T17:09:31.225 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2023-07-29T17:09:31.226 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2023-07-29T17:09:31.226 DEBUG:teuthology.orchestra.run.smithi073:> return f 2023-07-29T17:09:31.226 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-29T17:09:31.226 DEBUG:teuthology.orchestra.run.smithi073:> 2023-07-29T17:09:31.226 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2023-07-29T17:09:31.227 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-07-29T17:09:31.234 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:31.221+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:31.255 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:31.255 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:31.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:31.335 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:31.322+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:31.342 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.113917.asok 2023-07-29T17:09:31.409 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:31.409 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:31.409 INFO:teuthology.orchestra.run.smithi093.stdout: "num_ops": 0 2023-07-29T17:09:31.410 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:31.419 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:31.436 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:31.424+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:31.525 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.113917.asok 2023-07-29T17:09:31.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:31.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.113917.asok status 2023-07-29T17:09:31.537 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:31.525+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:31.587 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:31.587 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:31.587 INFO:teuthology.orchestra.run.smithi093.stdout: "complaint_time": 30, 2023-07-29T17:09:31.587 INFO:teuthology.orchestra.run.smithi093.stdout: "num_blocked_ops": 0 2023-07-29T17:09:31.588 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:31.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:31.638 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:31.626+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:31.681 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-07-29T17:09:31.681 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "0484097b0572e96f42cf6402cbe0ac8dcb046577", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc)", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "113917", 2023-07-29T17:09:31.682 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4644, 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2023-07-29T17:09:31.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4644 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3349204433 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:31.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3349204433 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4644 192.168.0.1:0/3349204433", 2023-07-29T17:09:31.685 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/3349204433", 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 6, 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 20, 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2023-07-29T17:09:31.686 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-07-29T17:09:31.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:31.691 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2023-07-29T17:09:31.691 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:31.709 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2023-07-29T17:09:31.709 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:31.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:31.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:31.725 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:31.725 INFO:teuthology.orchestra.run.smithi093.stdout: "size": 20, 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 600, 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [ 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.130857347000003, 2023-07-29T17:09:31.726 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012704160000000001, 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 116 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.727 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.728 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.729 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580935+0000", 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.649e-06 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.730 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580939+0000", 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.658e-06 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580942+0000", 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7199999999999998e-06 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.731 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588048+0000", 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.007105971 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.732 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588097+0000", 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9279e-05 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588183+0000", 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6169999999999997e-05 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.733 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589060+0000", 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00087682500000000002 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593496+0000", 2023-07-29T17:09:31.734 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0044364740000000001 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593579+0000", 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2255000000000004e-05 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.735 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593637+0000", 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.8615e-05 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.736 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.130846011999999, 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012802693, 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.737 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 117 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:31.738 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.739 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580947+0000", 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:31.740 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580952+0000", 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.0209999999999999e-06 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.741 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580955+0000", 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7750000000000001e-06 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588443+0000", 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0074877240000000003 2023-07-29T17:09:31.742 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588533+0000", 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.0561000000000002e-05 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.743 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588628+0000", 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.4355e-05 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589944+0000", 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001316401 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.744 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593693+0000", 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0037494529999999998 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593726+0000", 2023-07-29T17:09:31.745 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2359e-05 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593747+0000", 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.1364000000000001e-05 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.746 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.029224159000002, 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010198067999999999, 2023-07-29T17:09:31.747 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 137 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.748 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.750 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682611+0000", 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5226999999999999e-05 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682617+0000", 2023-07-29T17:09:31.751 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9599999999999997e-06 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682623+0000", 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4210000000000003e-06 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.752 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686489+0000", 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038660999999999999 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686535+0000", 2023-07-29T17:09:31.753 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6050999999999997e-05 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686606+0000", 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.1687000000000007e-05 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.754 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688623+0000", 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0020160569999999999 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692722+0000", 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0040992190000000003 2023-07-29T17:09:31.755 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692744+0000", 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2586e-05 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.756 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692764+0000", 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0035e-05 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.757 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.029164186999999, 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010220088, 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.758 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 138 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.759 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.760 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682628+0000", 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0959999999999999e-06 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.761 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682632+0000", 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0280000000000002e-06 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682636+0000", 2023-07-29T17:09:31.762 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.613e-06 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686959+0000", 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043234190000000002 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.763 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687005+0000", 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5695000000000002e-05 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687082+0000", 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.6922000000000007e-05 2023-07-29T17:09:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688629+0000", 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0015476050000000001 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.765 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692797+0000", 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0041680859999999997 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692825+0000", 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7928000000000001e-05 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.766 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692846+0000", 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0985e-05 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.767 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.029151931000001, 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010277467, 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.768 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 139 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.769 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.770 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682638+0000", 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682641+0000", 2023-07-29T17:09:31.771 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6460000000000002e-06 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682645+0000", 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9840000000000003e-06 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.772 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682648+0000", 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6060000000000001e-06 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687316+0000", 2023-07-29T17:09:31.773 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0046686189999999997 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687368+0000", 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2145999999999998e-05 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687439+0000", 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0261999999999999e-05 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688635+0000", 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0011961859999999999 2023-07-29T17:09:31.775 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692867+0000", 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0042322319999999998 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.776 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692895+0000", 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.8416999999999999e-05 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692916+0000", 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0602999999999999e-05 2023-07-29T17:09:31.777 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.029136078000001, 2023-07-29T17:09:31.778 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010365035999999999, 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 140 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.779 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.780 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.781 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682700+0000", 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6201e-05 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682705+0000", 2023-07-29T17:09:31.782 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3669999999999999e-06 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682708+0000", 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.783 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687669+0000", 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0049609889999999999 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687717+0000", 2023-07-29T17:09:31.784 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.8364e-05 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687791+0000", 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3783999999999997e-05 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.785 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688641+0000", 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00085023200000000003 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692974+0000", 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043330160000000003 2023-07-29T17:09:31.786 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693000+0000", 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6179000000000001e-05 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.787 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693019+0000", 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.9326000000000001e-05 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:31.788 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 33.029079619000001, 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010373451000000001, 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:31.789 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 141 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.790 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.791 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682714+0000", 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6260000000000001e-06 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.792 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682717+0000", 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2490000000000001e-06 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682720+0000", 2023-07-29T17:09:31.793 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5019999999999999e-06 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688243+0000", 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055235320000000003 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.794 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688298+0000", 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4863e-05 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688378+0000", 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9877999999999997e-05 2023-07-29T17:09:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.689466+0000", 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0010876250000000001 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.796 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693041+0000", 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0035748099999999999 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693066+0000", 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5592000000000002e-05 2023-07-29T17:09:31.797 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693084+0000", 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8051999999999999e-05 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.798 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.913597772999999, 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01054736, 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.799 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.800 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798191+0000", 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:31.801 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798200+0000", 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.3890000000000005e-06 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.802 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798441+0000", 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00024168400000000001 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798460+0000", 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8791e-05 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.803 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800079+0000", 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001618436 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.804 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800239+0000", 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000160051 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800394+0000", 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000155847 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.805 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.807144+0000", 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067495480000000002 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808238+0000", 2023-07-29T17:09:31.806 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001094308 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808284+0000", 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5327000000000002e-05 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.807 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808740+0000", 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000456398 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.808 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.912694982000001, 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012771879999999999, 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.809 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:31.810 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799095+0000", 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.811 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799101+0000", 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6510000000000004e-06 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799115+0000", 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.3427e-05 2023-07-29T17:09:31.812 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799123+0000", 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2199999999999992e-06 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.813 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804445+0000", 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053221850000000001 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804551+0000", 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000106205 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.814 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804694+0000", 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0001428 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811719+0000", 2023-07-29T17:09:31.815 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0070253709999999999 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811784+0000", 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.4465e-05 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.816 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811827+0000", 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3235000000000002e-05 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811867+0000", 2023-07-29T17:09:31.817 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0238999999999999e-05 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:31.818 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.912657312, 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.014863889, 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:31.819 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.820 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799137+0000", 2023-07-29T17:09:31.821 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799147+0000", 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.9599999999999995e-06 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.822 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4793999999999997e-05 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805488+0000", 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0062865489999999998 2023-07-29T17:09:31.823 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806468+0000", 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00097922599999999992 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.824 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806765+0000", 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00029750499999999999 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813753+0000", 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0069874689999999996 2023-07-29T17:09:31.825 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813893+0000", 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000140226 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.826 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813938+0000", 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.4642999999999999e-05 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813997+0000", 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9506999999999998e-05 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.827 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.912551112999999, 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015133384999999999, 2023-07-29T17:09:31.828 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.829 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799238+0000", 2023-07-29T17:09:31.830 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799246+0000", 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3470000000000001e-06 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.831 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799257+0000", 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1331999999999999e-05 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799266+0000", 2023-07-29T17:09:31.832 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.7180000000000002e-06 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810513+0000", 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011246920000000001 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.833 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810627+0000", 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000114282 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811304+0000", 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067641100000000003 2023-07-29T17:09:31.834 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814140+0000", 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.002836281 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.835 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814300+0000", 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00016066 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814336+0000", 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5805e-05 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.836 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814373+0000", 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6508999999999999e-05 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.837 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.912207933000001, 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015275607, 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.838 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799582+0000", 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799588+0000", 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6590000000000004e-06 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799597+0000", 2023-07-29T17:09:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.6649999999999998e-06 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799605+0000", 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1170000000000004e-06 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812036+0000", 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430636 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812463+0000", 2023-07-29T17:09:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00042748299999999999 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812602+0000", 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00013831499999999999 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001908893 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814800+0000", 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00028917999999999999 2023-07-29T17:09:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814836+0000", 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5948999999999998e-05 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814858+0000", 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2390000000000001e-05 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:16 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.912147561000001, 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010747720000000001, 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799642+0000", 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799646+0000", 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9620000000000004e-06 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799654+0000", 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.199e-06 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799661+0000", 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.9530000000000002e-06 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800044+0000", 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000383046 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800233+0000", 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018905699999999999 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800418+0000", 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018494099999999999 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806466+0000", 2023-07-29T17:09:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0060481170000000004 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810286+0000", 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038198450000000001 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810348+0000", 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2062000000000003e-05 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810391+0000", 2023-07-29T17:09:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3031000000000002e-05 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911941054, 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015461856, 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799855+0000", 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8020000000000003e-06 2023-07-29T17:09:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799865+0000", 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.628e-06 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799873+0000", 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1480000000000006e-06 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812921+0000", 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013048110999999999 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813008+0000", 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6581000000000003e-05 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813143+0000", 2023-07-29T17:09:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000135258 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814890+0000", 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001747293 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815225+0000", 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000334648 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815268+0000", 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815311+0000", 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3349000000000001e-05 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911814930999999, 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010570684, 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.867 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799975+0000", 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799979+0000", 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.7419999999999999e-06 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799986+0000", 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2710000000000003e-06 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799993+0000", 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2150000000000004e-06 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802486+0000", 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0024926330000000002 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802589+0000", 2023-07-29T17:09:31.872 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000103041 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802782+0000", 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00019310599999999999 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808103+0000", 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053207870000000004 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810437+0000", 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0023346930000000001 2023-07-29T17:09:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810480+0000", 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810546+0000", 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6005000000000002e-05 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911783767999999, 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011747502, 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.877 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800006+0000", 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800017+0000", 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1147e-05 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800025+0000", 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.8329999999999994e-06 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800033+0000", 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9100000000000005e-06 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800215+0000", 2023-07-29T17:09:31.881 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018224800000000001 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800360+0000", 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000144676 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800811+0000", 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000451457 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055944840000000003 2023-07-29T17:09:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811663+0000", 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052574379999999997 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811713+0000", 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9375000000000001e-05 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811754+0000", 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1445e-05 2023-07-29T17:09:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911743863000002, 2023-07-29T17:09:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01314661, 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800046+0000", 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800051+0000", 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5979999999999999e-06 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800060+0000", 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.482e-06 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800067+0000", 2023-07-29T17:09:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0430000000000002e-06 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802741+0000", 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0026741289999999999 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.891 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802884+0000", 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014245699999999999 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.803031+0000", 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014711699999999999 2023-07-29T17:09:31.892 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808271+0000", 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052402430000000003 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.893 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813100+0000", 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0048288360000000004 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813152+0000", 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.1560000000000001e-05 2023-07-29T17:09:31.894 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813193+0000", 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1690000000000002e-05 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.895 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.91165209, 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013580643, 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.896 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.897 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.898 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800148+0000", 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.0010000000000001e-05 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800154+0000", 2023-07-29T17:09:31.899 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.1680000000000001e-06 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800158+0000", 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1110000000000001e-06 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.900 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804064+0000", 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0039061370000000001 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804183+0000", 2023-07-29T17:09:31.901 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00011890100000000001 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804326+0000", 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014277300000000001 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.902 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811446+0000", 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0071207800000000002 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813290+0000", 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0018438899999999999 2023-07-29T17:09:31.903 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813347+0000", 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6555999999999999e-05 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.904 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813719+0000", 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000372142 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.905 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911608951000002, 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430045000000001, 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.906 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:31.907 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800181+0000", 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.908 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800185+0000", 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1659999999999996e-06 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800192+0000", 2023-07-29T17:09:31.909 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2339999999999997e-06 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800199+0000", 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.7950000000000002e-06 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.910 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801571+0000", 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001372201 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801715+0000", 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014396499999999999 2023-07-29T17:09:31.911 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802391+0000", 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067586000000000002 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.912 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.809114+0000", 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067226910000000003 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812051+0000", 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0029367920000000001 2023-07-29T17:09:31.913 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812103+0000", 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2806000000000002e-05 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.914 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812612+0000", 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00050817099999999997 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:31.915 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 22.911529784999999, 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013634713999999999, 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "started", 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.916 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:31.917 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800260+0000", 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:31.918 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800264+0000", 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6040000000000001e-06 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800270+0000", 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2820000000000002e-06 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.919 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800277+0000", 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8800000000000002e-06 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805286+0000", 2023-07-29T17:09:31.920 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0050090320000000001 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805474+0000", 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018839799999999999 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:31.921 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813895+0000", 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0084212560000000002 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:31.922 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:31.923 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:31.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:31.925 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:31.911+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:31.950 INFO:teuthology.run_tasks:Running task exec... 2023-07-29T17:09:31.960 INFO:teuthology.task.exec:Executing custom commands... 2023-07-29T17:09:31.960 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T17:09:31.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'dd if=/dev/zero of=./foo count=100' 2023-07-29T17:09:32.017 INFO:teuthology.orchestra.run.smithi073.stderr:100+0 records in 2023-07-29T17:09:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:100+0 records out 2023-07-29T17:09:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:51200 bytes (51 kB, 50 KiB) copied, 0.000211785 s, 242 MB/s 2023-07-29T17:09:32.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sleep 2' 2023-07-29T17:09:32.024 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:32.010+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:32.064 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:32.065 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:32.065 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:32.065 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:32.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:32.124 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:32.112+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:32.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T17:09:32.225 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:32.212+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:32.243 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:32.244 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:32.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:32.336 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:32.323+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:32.422 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:32.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.938040706000002, 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:32.423 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:32.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:32.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:32.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:32.431 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.723654891000002, 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:32.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:32.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:32.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:32.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.722099370999999, 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:32.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:32.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:32.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.721607087000002, 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.451 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:32.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:32.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.721250255999998, 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:32.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.720815743000003, 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:32.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:32.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:32.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:32.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:32.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.610472629, 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.610019726000001, 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609589701000001, 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609544922000001, 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609517771, 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609493196999999, 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609479693000001, 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609459622999999, 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.609245649000002, 2023-07-29T17:09:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.602848058999999, 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.602466367000002, 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.602443667999999, 2023-07-29T17:09:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:32.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:32.583 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.602181367, 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:32.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:32.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:32.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:32.590 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.602082040999999, 2023-07-29T17:09:32.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:32.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:32.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:32.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:32.598 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:32.598 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:32.599 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:32.585+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:32.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:32.700 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:32.687+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:32.742 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:32.743 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:32.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:32.800 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:32.788+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:32.901 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:32.889+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:32.920 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2023-07-29T17:09:32.921 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:32.921 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:32.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:33.002 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:32.989+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:33.098 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:33.098 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:33.102 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:33.090+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:33.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:33.203 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:33.190+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:33.251 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:33.251 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:33.252 INFO:teuthology.orchestra.run.smithi093.stdout: "num_ops": 0 2023-07-29T17:09:33.252 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:33.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:33.303 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:33.291+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:33.367 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2023-07-29T17:09:33.389 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:33.390 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:33.390 INFO:teuthology.orchestra.run.smithi093.stdout: "complaint_time": 30, 2023-07-29T17:09:33.390 INFO:teuthology.orchestra.run.smithi093.stdout: "num_blocked_ops": 0 2023-07-29T17:09:33.390 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:33.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:33.404 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:33.392+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:33.504 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:33.491+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:33.529 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:33.529 INFO:teuthology.orchestra.run.smithi093.stdout: "size": 20, 2023-07-29T17:09:33.529 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 600, 2023-07-29T17:09:33.529 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [ 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.934453277000003, 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012704160000000001, 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.530 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 116 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.531 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:33.532 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.533 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580935+0000", 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.649e-06 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580939+0000", 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.658e-06 2023-07-29T17:09:33.534 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580942+0000", 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7199999999999998e-06 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.535 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588048+0000", 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.007105971 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588097+0000", 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9279e-05 2023-07-29T17:09:33.536 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588183+0000", 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6169999999999997e-05 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.537 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589060+0000", 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00087682500000000002 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593496+0000", 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0044364740000000001 2023-07-29T17:09:33.538 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593579+0000", 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2255000000000004e-05 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.539 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593637+0000", 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.8615e-05 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.540 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.934441941999999, 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012802693, 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.541 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 117 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.542 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.543 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580947+0000", 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.544 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580952+0000", 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.0209999999999999e-06 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580955+0000", 2023-07-29T17:09:33.545 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7750000000000001e-06 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588443+0000", 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0074877240000000003 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.546 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588533+0000", 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.0561000000000002e-05 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588628+0000", 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.4355e-05 2023-07-29T17:09:33.547 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589944+0000", 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001316401 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.548 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593693+0000", 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0037494529999999998 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593726+0000", 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2359e-05 2023-07-29T17:09:33.549 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593747+0000", 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.1364000000000001e-05 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.550 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.832820089000002, 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010198067999999999, 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.551 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 137 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.552 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.553 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.554 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682611+0000", 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5226999999999999e-05 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682617+0000", 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9599999999999997e-06 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.555 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682623+0000", 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4210000000000003e-06 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.556 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686489+0000", 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038660999999999999 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686535+0000", 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6050999999999997e-05 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.557 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686606+0000", 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.1687000000000007e-05 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688623+0000", 2023-07-29T17:09:33.558 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0020160569999999999 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692722+0000", 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0040992190000000003 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.559 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692744+0000", 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2586e-05 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692764+0000", 2023-07-29T17:09:33.560 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0035e-05 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:33.561 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.832760116999999, 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010220088, 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 138 2023-07-29T17:09:33.562 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.563 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.564 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682628+0000", 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0959999999999999e-06 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.565 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682632+0000", 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0280000000000002e-06 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682636+0000", 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.613e-06 2023-07-29T17:09:33.566 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686959+0000", 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043234190000000002 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.567 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687005+0000", 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5695000000000002e-05 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687082+0000", 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.6922000000000007e-05 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.568 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688629+0000", 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0015476050000000001 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692797+0000", 2023-07-29T17:09:33.569 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0041680859999999997 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692825+0000", 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7928000000000001e-05 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.570 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692846+0000", 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0985e-05 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.571 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.832747861000001, 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010277467, 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.572 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 139 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:33.573 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.574 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682638+0000", 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682641+0000", 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6460000000000002e-06 2023-07-29T17:09:33.575 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682645+0000", 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9840000000000003e-06 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.576 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682648+0000", 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6060000000000001e-06 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687316+0000", 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0046686189999999997 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.577 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687368+0000", 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2145999999999998e-05 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.578 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687439+0000", 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0261999999999999e-05 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688635+0000", 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0011961859999999999 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.579 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692867+0000", 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0042322319999999998 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692895+0000", 2023-07-29T17:09:33.580 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.8416999999999999e-05 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692916+0000", 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0602999999999999e-05 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.581 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.832732008000001, 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010365035999999999, 2023-07-29T17:09:33.582 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 140 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.583 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:33.584 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.585 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682700+0000", 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6201e-05 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682705+0000", 2023-07-29T17:09:33.586 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3669999999999999e-06 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682708+0000", 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.587 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687669+0000", 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0049609889999999999 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687717+0000", 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.8364e-05 2023-07-29T17:09:33.588 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687791+0000", 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3783999999999997e-05 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.589 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688641+0000", 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00085023200000000003 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692974+0000", 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043330160000000003 2023-07-29T17:09:33.590 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693000+0000", 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6179000000000001e-05 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.591 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693019+0000", 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.9326000000000001e-05 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:33.592 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 34.832675549000001, 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010373451000000001, 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:33.593 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 141 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.594 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.595 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682714+0000", 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6260000000000001e-06 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.596 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682717+0000", 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2490000000000001e-06 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682720+0000", 2023-07-29T17:09:33.597 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5019999999999999e-06 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688243+0000", 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055235320000000003 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.598 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688298+0000", 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4863e-05 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688378+0000", 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9877999999999997e-05 2023-07-29T17:09:33.599 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.689466+0000", 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0010876250000000001 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.600 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693041+0000", 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0035748099999999999 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693066+0000", 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5592000000000002e-05 2023-07-29T17:09:33.601 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693084+0000", 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8051999999999999e-05 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.602 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.717193703, 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01054736, 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.603 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.604 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798191+0000", 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:33.605 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798200+0000", 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.3890000000000005e-06 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.606 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798441+0000", 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00024168400000000001 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798460+0000", 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8791e-05 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.607 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800079+0000", 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001618436 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.608 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800239+0000", 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000160051 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800394+0000", 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000155847 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.609 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.807144+0000", 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067495480000000002 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808238+0000", 2023-07-29T17:09:33.610 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001094308 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808284+0000", 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5327000000000002e-05 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.611 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808740+0000", 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000456398 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.612 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.716290912000002, 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012771879999999999, 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.613 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:33.614 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799095+0000", 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.615 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799101+0000", 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6510000000000004e-06 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799115+0000", 2023-07-29T17:09:33.616 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.3427e-05 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799123+0000", 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2199999999999992e-06 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.617 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804445+0000", 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053221850000000001 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804551+0000", 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000106205 2023-07-29T17:09:33.618 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804694+0000", 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0001428 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.619 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811719+0000", 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0070253709999999999 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811784+0000", 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.4465e-05 2023-07-29T17:09:33.620 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811827+0000", 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3235000000000002e-05 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.621 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811867+0000", 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0238999999999999e-05 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.622 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.716253242000001, 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.014863889, 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.623 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.624 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.625 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799137+0000", 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799147+0000", 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.9599999999999995e-06 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.626 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4793999999999997e-05 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805488+0000", 2023-07-29T17:09:33.627 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0062865489999999998 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806468+0000", 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00097922599999999992 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.628 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806765+0000", 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00029750499999999999 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813753+0000", 2023-07-29T17:09:33.629 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0069874689999999996 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813893+0000", 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000140226 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.630 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813938+0000", 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.4642999999999999e-05 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813997+0000", 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9506999999999998e-05 2023-07-29T17:09:33.631 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:33.632 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.716147042999999, 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015133384999999999, 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:33.633 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.634 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799238+0000", 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799246+0000", 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3470000000000001e-06 2023-07-29T17:09:33.635 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799257+0000", 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1331999999999999e-05 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.636 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799266+0000", 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.7180000000000002e-06 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810513+0000", 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011246920000000001 2023-07-29T17:09:33.637 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810627+0000", 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000114282 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.638 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811304+0000", 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067641100000000003 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814140+0000", 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.002836281 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.639 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814300+0000", 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00016066 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814336+0000", 2023-07-29T17:09:33.640 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5805e-05 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814373+0000", 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6508999999999999e-05 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.641 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715803863000001, 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015275607, 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.642 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.643 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799582+0000", 2023-07-29T17:09:33.644 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799588+0000", 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6590000000000004e-06 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.645 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799597+0000", 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.6649999999999998e-06 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799605+0000", 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1170000000000004e-06 2023-07-29T17:09:33.646 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812036+0000", 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430636 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.647 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812463+0000", 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00042748299999999999 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812602+0000", 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00013831499999999999 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.648 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001908893 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.649 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814800+0000", 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00028917999999999999 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814836+0000", 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5948999999999998e-05 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.650 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814858+0000", 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2390000000000001e-05 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.651 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:16 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715743491000001, 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010747720000000001, 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.652 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.653 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799642+0000", 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.654 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799646+0000", 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9620000000000004e-06 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799654+0000", 2023-07-29T17:09:33.655 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.199e-06 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799661+0000", 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.9530000000000002e-06 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.656 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800044+0000", 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000383046 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800233+0000", 2023-07-29T17:09:33.657 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018905699999999999 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800418+0000", 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018494099999999999 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.658 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806466+0000", 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0060481170000000004 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810286+0000", 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038198450000000001 2023-07-29T17:09:33.659 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810348+0000", 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2062000000000003e-05 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.660 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810391+0000", 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3031000000000002e-05 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.661 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715536984, 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015461856, 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.662 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.663 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.664 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799855+0000", 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8020000000000003e-06 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799865+0000", 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.628e-06 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.665 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799873+0000", 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1480000000000006e-06 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812921+0000", 2023-07-29T17:09:33.666 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013048110999999999 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813008+0000", 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6581000000000003e-05 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.667 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813143+0000", 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000135258 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814890+0000", 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001747293 2023-07-29T17:09:33.668 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815225+0000", 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000334648 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.669 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815268+0000", 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815311+0000", 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3349000000000001e-05 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715410860999999, 2023-07-29T17:09:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010570684, 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.673 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799975+0000", 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799979+0000", 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.7419999999999999e-06 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.674 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799986+0000", 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2710000000000003e-06 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799993+0000", 2023-07-29T17:09:33.675 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2150000000000004e-06 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802486+0000", 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0024926330000000002 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.676 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802589+0000", 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000103041 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802782+0000", 2023-07-29T17:09:33.677 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00019310599999999999 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808103+0000", 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053207870000000004 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.678 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810437+0000", 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0023346930000000001 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810480+0000", 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:33.679 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810546+0000", 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6005000000000002e-05 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.680 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715379698, 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011747502, 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.681 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.682 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800006+0000", 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.683 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800017+0000", 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1147e-05 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800025+0000", 2023-07-29T17:09:33.684 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.8329999999999994e-06 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800033+0000", 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9100000000000005e-06 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.685 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800215+0000", 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018224800000000001 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800360+0000", 2023-07-29T17:09:33.686 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000144676 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800811+0000", 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000451457 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.687 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055944840000000003 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811663+0000", 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052574379999999997 2023-07-29T17:09:33.688 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811713+0000", 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9375000000000001e-05 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.689 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811754+0000", 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1445e-05 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.690 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715339792999998, 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01314661, 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.691 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.692 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800046+0000", 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.693 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800051+0000", 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5979999999999999e-06 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800060+0000", 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.482e-06 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.694 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800067+0000", 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0430000000000002e-06 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802741+0000", 2023-07-29T17:09:33.695 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0026741289999999999 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802884+0000", 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014245699999999999 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.696 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.803031+0000", 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014711699999999999 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808271+0000", 2023-07-29T17:09:33.697 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052402430000000003 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813100+0000", 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0048288360000000004 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.698 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813152+0000", 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.1560000000000001e-05 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813193+0000", 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1690000000000002e-05 2023-07-29T17:09:33.699 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715248020000001, 2023-07-29T17:09:33.700 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013580643, 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:33.701 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.702 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800148+0000", 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.0010000000000001e-05 2023-07-29T17:09:33.703 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800154+0000", 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.1680000000000001e-06 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.704 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800158+0000", 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1110000000000001e-06 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804064+0000", 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0039061370000000001 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.705 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804183+0000", 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00011890100000000001 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:33.706 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804326+0000", 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014277300000000001 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811446+0000", 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0071207800000000002 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.707 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813290+0000", 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0018438899999999999 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813347+0000", 2023-07-29T17:09:33.708 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6555999999999999e-05 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813719+0000", 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000372142 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.709 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715204880999998, 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430045000000001, 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.710 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.711 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800181+0000", 2023-07-29T17:09:33.712 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800185+0000", 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1659999999999996e-06 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.713 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800192+0000", 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2339999999999997e-06 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800199+0000", 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.7950000000000002e-06 2023-07-29T17:09:33.714 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801571+0000", 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001372201 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.715 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801715+0000", 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014396499999999999 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802391+0000", 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067586000000000002 2023-07-29T17:09:33.716 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.809114+0000", 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067226910000000003 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:33.717 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812051+0000", 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0029367920000000001 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812103+0000", 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2806000000000002e-05 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.718 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812612+0000", 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00050817099999999997 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.719 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 24.715125714999999, 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013634713999999999, 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "started", 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:33.720 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:33.721 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800260+0000", 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.722 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800264+0000", 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6040000000000001e-06 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800270+0000", 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2820000000000002e-06 2023-07-29T17:09:33.723 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800277+0000", 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8800000000000002e-06 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.724 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805286+0000", 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0050090320000000001 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805474+0000", 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018839799999999999 2023-07-29T17:09:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813895+0000", 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0084212560000000002 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.726 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:33.727 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:33.727 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:33.728 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:33.729 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:33.716+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:33.828 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:33.815+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:33.869 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:33.869 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:33.869 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:33.869 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:33.879 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:33.929 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:33.917+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:34.024 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T17:09:34.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T17:09:34.025 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T17:09:34.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T17:09:34.030 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:34.018+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:34.047 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:34.047 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:34.047 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:34.048 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:34.048 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:34.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:34.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'truncate --size 0 ./foo' 2023-07-29T17:09:34.122 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-29T17:09:34.134 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-29T17:09:34.134 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:09:34.134 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T17:09:34.135 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:34.122+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:34.181 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:09:34.181 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T17:09:34.187 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:34.187 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:34.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:34.187 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:34.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.702691936999997, 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:34.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.488306121999997, 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:34.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:34.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.486750602000001, 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:34.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:34.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.211 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.212 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:34.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:34.213 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.486258317999997, 2023-07-29T17:09:34.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:34.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:34.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:34.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:34.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:34.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:34.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.485901487, 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:34.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:34.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.485466973999998, 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:34.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:34.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:34.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.375123859999999, 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:34.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:34.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:34.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:34.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:34.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:34.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:34.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:34.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:34.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374670956999999, 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.253 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:34.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:34.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:34.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:34.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:34.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374240931999999, 2023-07-29T17:09:34.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:34.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:34.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:34.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374196153, 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:34.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:34.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:34.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:34.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374169001999999, 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:34.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:34.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374144428000001, 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.293 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:34.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374130923999999, 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.303 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:34.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:34.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:34.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:34.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:34.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.374110854000001, 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:34.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:34.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:34.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.37389688, 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:34.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.367499290000001, 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:34.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:34.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:34.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:34.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.367117598, 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:34.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:34.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.367094899000001, 2023-07-29T17:09:34.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:34.344 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.344 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.344 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.366832597999998, 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:34.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:34.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:34.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:34.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:34.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:34.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:34.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:34.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:34.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.362 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:34.362 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:34.362 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.366733272000001, 2023-07-29T17:09:34.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:34.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:34.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:34.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:34.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:34.369 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:34.370 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:34.358+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 21, 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "a332a6fa-930f-490b-a8e4-4300ea7abc2a", 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2023-07-29T17:08:46.582422+0000", 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2023-07-29T17:09:33.341350+0000", 2023-07-29T17:09:34.371 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2023-07-29T17:08:55.071812+0000", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2023-07-29T17:08:47.499348+0000", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2023-07-29T17:09:34.372 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T17:09:34.373 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2023-07-29T17:09:34.374 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2023-07-29T17:08:56.668318+0000", 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2023-07-29T17:09:34.375 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2023-07-29T17:09:34.376 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2023-07-29T17:09:34.377 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "12", 2023-07-29T17:09:34.378 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2023-07-29T17:09:34.379 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2023-07-29T17:09:34.380 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2023-07-29T17:09:34.381 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2023-07-29T17:09:34.382 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2023-07-29T17:09:34.383 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2023-07-29T17:09:34.384 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2023-07-29T17:09:34.385 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2023-07-29T17:09:34.385 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T17:09:34.385 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2023-07-29T17:09:34.385 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2023-07-29T17:09:34.385 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2023-07-29T17:09:34.386 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2023-07-29T17:09:01.905239+0000", 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2023-07-29T17:09:34.387 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2023-07-29T17:09:34.388 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2023-07-29T17:09:34.389 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "15", 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2023-07-29T17:09:34.390 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2023-07-29T17:09:34.391 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2023-07-29T17:09:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2023-07-29T17:09:34.393 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2023-07-29T17:09:34.394 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2023-07-29T17:09:34.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2023-07-29T17:09:34.396 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2023-07-29T17:09:34.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2023-07-29T17:09:34.398 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2023-07-29T17:09:06.456697+0000", 2023-07-29T17:09:34.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-07-29T17:09:34.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2023-07-29T17:09:34.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2023-07-29T17:09:34.399 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2023-07-29T17:09:34.399 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2023-07-29T17:09:34.399 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2023-07-29T17:09:34.399 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2023-07-29T17:09:34.400 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2023-07-29T17:09:34.400 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T17:09:34.400 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T17:09:34.401 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2023-07-29T17:09:34.401 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2023-07-29T17:09:34.401 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2023-07-29T17:09:34.401 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2023-07-29T17:09:34.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2023-07-29T17:09:34.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2023-07-29T17:09:34.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2023-07-29T17:09:34.402 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2023-07-29T17:09:34.403 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2023-07-29T17:09:34.403 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2023-07-29T17:09:34.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2023-07-29T17:09:34.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2023-07-29T17:09:34.404 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2023-07-29T17:09:34.404 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2023-07-29T17:09:34.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.404 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2023-07-29T17:09:34.404 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2023-07-29T17:09:34.405 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2023-07-29T17:09:34.406 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2023-07-29T17:09:34.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2023-07-29T17:09:34.408 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2023-07-29T17:09:34.409 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2023-07-29T17:09:34.410 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2023-07-29T17:09:34.410 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2023-07-29T17:09:34.410 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2023-07-29T17:09:34.410 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2023-07-29T17:09:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2023-07-29T17:09:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2023-07-29T17:09:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2023-07-29T17:09:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2023-07-29T17:09:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2023-07-29T17:09:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2023-07-29T17:09:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2023-07-29T17:09:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2023-07-29T17:09:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T17:09:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T17:09:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2023-07-29T17:09:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2023-07-29T17:09:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2023-07-29T17:09:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2023-07-29T17:09:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2023-07-29T17:09:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2023-07-29T17:09:07.770105+0000", 2023-07-29T17:09:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-07-29T17:09:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2023-07-29T17:09:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2023-07-29T17:09:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2023-07-29T17:09:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2023-07-29T17:09:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2023-07-29T17:09:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2023-07-29T17:09:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2023-07-29T17:09:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T17:09:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T17:09:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2023-07-29T17:09:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2023-07-29T17:09:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2023-07-29T17:09:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2023-07-29T17:09:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2023-07-29T17:09:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2023-07-29T17:09:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2023-07-29T17:09:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2023-07-29T17:09:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2023-07-29T17:09:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "19", 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2023-07-29T17:09:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2023-07-29T17:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2023-07-29T17:09:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2023-07-29T17:09:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2023-07-29T17:09:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2023-07-29T17:09:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2023-07-29T17:09:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2023-07-29T17:09:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T17:09:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T17:09:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2023-07-29T17:09:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2023-07-29T17:09:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2023-07-29T17:09:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9", 2023-07-29T17:09:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2023-07-29T17:09:34.432 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 17, 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6800", 2023-07-29T17:09:34.433 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6801", 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6802", 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6803", 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.436 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6806", 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.437 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6807", 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6804", 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.92:6805", 2023-07-29T17:09:34.439 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110190 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.92:6801/110190", 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.92:6803/110190", 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.92:6807/110190", 2023-07-29T17:09:34.440 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.92:6805/110190", 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2023-07-29T17:09:34.441 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "ee52c2b3-837b-4ab3-8826-4fae9cff4ee7", 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2023-07-29T17:09:34.442 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 17, 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.443 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6800", 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6801", 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.444 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6802", 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6803", 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6806", 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6807", 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.453 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2023-07-29T17:09:34.453 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6804", 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.93:6805", 2023-07-29T17:09:34.454 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110230 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.93:6801/110230", 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.93:6803/110230", 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.93:6807/110230", 2023-07-29T17:09:34.455 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.93:6805/110230", 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.456 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "940667e0-3fe5-459e-8934-96e6b34a39ec", 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2023-07-29T17:09:34.457 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 17, 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6800", 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6801", 2023-07-29T17:09:34.459 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6802", 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6803", 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6806", 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6807", 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2023-07-29T17:09:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6804", 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-07-29T17:09:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.153:6805", 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 110381 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.153:6801/110381", 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.153:6803/110381", 2023-07-29T17:09:34.466 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.153:6807/110381", 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.153:6805/110381", 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-07-29T17:09:34.467 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2023-07-29T17:09:34.468 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2023-07-29T17:08:52.602217+0000", 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2023-07-29T17:09:34.469 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2023-07-29T17:09:34.470 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2023-07-29T17:09:34.470 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2023-07-29T17:09:34.470 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2023-07-29T17:09:34.470 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2023-07-29T17:08:52.550112+0000", 2023-07-29T17:09:34.470 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2023-07-29T17:09:34.471 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2023-07-29T17:09:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2023-07-29T17:09:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2023-07-29T17:09:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2023-07-29T17:08:52.537070+0000", 2023-07-29T17:09:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2023-07-29T17:09:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2023-07-29T17:09:34.474 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2023-07-29T17:09:34.475 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2023-07-29T17:09:34.476 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2023-07-29T17:09:34.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-07-29T17:09:34.477 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-07-29T17:09:34.477 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:34.480 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': 'a332a6fa-930f-490b-a8e4-4300ea7abc2a', 'created': '2023-07-29T17:08:46.582422+0000', 'modified': '2023-07-29T17:09:33.341350+0000', 'last_up_change': '2023-07-29T17:08:55.071812+0000', 'last_in_change': '2023-07-29T17:08:47.499348+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T17:09:06.456697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T17:09:07.770105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6800', 'nonce': 110190}, {'type': 'v1', 'addr': '172.21.15.92:6801', 'nonce': 110190}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6802', 'nonce': 110190}, {'type': 'v1', 'addr': '172.21.15.92:6803', 'nonce': 110190}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6806', 'nonce': 110190}, {'type': 'v1', 'addr': '172.21.15.92:6807', 'nonce': 110190}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6804', 'nonce': 110190}, {'type': 'v1', 'addr': '172.21.15.92:6805', 'nonce': 110190}]}, 'public_addr': '172.21.15.92:6801/110190', 'cluster_addr': '172.21.15.92:6803/110190', 'heartbeat_back_addr': '172.21.15.92:6807/110190', 'heartbeat_front_addr': '172.21.15.92:6805/110190', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'ee52c2b3-837b-4ab3-8826-4fae9cff4ee7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6800', 'nonce': 110230}, {'type': 'v1', 'addr': '172.21.15.93:6801', 'nonce': 110230}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6802', 'nonce': 110230}, {'type': 'v1', 'addr': '172.21.15.93:6803', 'nonce': 110230}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6806', 'nonce': 110230}, {'type': 'v1', 'addr': '172.21.15.93:6807', 'nonce': 110230}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6804', 'nonce': 110230}, {'type': 'v1', 'addr': '172.21.15.93:6805', 'nonce': 110230}]}, 'public_addr': '172.21.15.93:6801/110230', 'cluster_addr': '172.21.15.93:6803/110230', 'heartbeat_back_addr': '172.21.15.93:6807/110230', 'heartbeat_front_addr': '172.21.15.93:6805/110230', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '940667e0-3fe5-459e-8934-96e6b34a39ec', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 110381}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 110381}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 110381}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 110381}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 110381}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 110381}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 110381}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 110381}]}, 'public_addr': '172.21.15.153:6801/110381', 'cluster_addr': '172.21.15.153:6803/110381', 'heartbeat_back_addr': '172.21.15.153:6807/110381', 'heartbeat_front_addr': '172.21.15.153:6805/110381', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T17:08:52.602217+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T17:08:52.550112+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T17:08:52.537070+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T17:09:34.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:09:34.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:34.518 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:34.505+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:34.579 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:34.567+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:34.621 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:34.621 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:34.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:34.679 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:34.667+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:34.759 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:34.759 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:34.769 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:34.780 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:34.767+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:34.853 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:34.853 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:33.341350+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:34.857 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-07-29T17:09:34.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T17:09:06.456697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T17:09:07.770105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:34.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:34.871 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-07-29T17:09:34.634280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81528,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283033992,"statfs":{"total":289910292480,"available":289826807808,"internally_reserved":0,"allocated":688128,"data_stored":1366975,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001745"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637409+0000","last_change":"2023-07-29T17:09:08.809646+0000","last_active":"2023-07-29T17:09:10.637409+0000","last_peered":"2023-07-29T17:09:10.637409+0000","last_clean":"2023-07-29T17:09:10.637409+0000","last_became_active":"2023-07-29T17:09:08.808830+0000","last_became_peered":"2023-07-29T17:09:08.808830+0000","last_unstale":"2023-07-29T17:09:10.637409+0000","last_undegraded":"2023-07-29T17:09:10.637409+0000","last_fullsized":"2023-07-29T17:09:10.637409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637341+0000","last_change":"2023-07-29T17:09:08.806069+0000","last_active":"2023-07-29T17:09:10.637341+0000","last_peered":"2023-07-29T17:09:10.637341+0000","last_clean":"2023-07-29T17:09:10.637341+0000","last_became_active":"2023-07-29T17:09:08.805505+0000","last_became_peered":"2023-07-29T17:09:08.805505+0000","last_unstale":"2023-07-29T17:09:10.637341+0000","last_undegraded":"2023-07-29T17:09:10.637341+0000","last_fullsized":"2023-07-29T17:09:10.637341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636541+0000","last_change":"2023-07-29T17:09:08.807848+0000","last_active":"2023-07-29T17:09:10.636541+0000","last_peered":"2023-07-29T17:09:10.636541+0000","last_clean":"2023-07-29T17:09:10.636541+0000","last_became_active":"2023-07-29T17:09:08.806687+0000","last_became_peered":"2023-07-29T17:09:08.806687+0000","last_unstale":"2023-07-29T17:09:10.636541+0000","last_undegraded":"2023-07-29T17:09:10.636541+0000","last_fullsized":"2023-07-29T17:09:10.636541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636502+0000","last_change":"2023-07-29T17:09:08.807056+0000","last_active":"2023-07-29T17:09:10.636502+0000","last_peered":"2023-07-29T17:09:10.636502+0000","last_clean":"2023-07-29T17:09:10.636502+0000","last_became_active":"2023-07-29T17:09:08.806588+0000","last_became_peered":"2023-07-29T17:09:08.806588+0000","last_unstale":"2023-07-29T17:09:10.636502+0000","last_undegraded":"2023-07-29T17:09:10.636502+0000","last_fullsized":"2023-07-29T17:09:10.636502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:50:17.638823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637213+0000","last_change":"2023-07-29T17:09:08.807061+0000","last_active":"2023-07-29T17:09:10.637213+0000","last_peered":"2023-07-29T17:09:10.637213+0000","last_clean":"2023-07-29T17:09:10.637213+0000","last_became_active":"2023-07-29T17:09:08.806741+0000","last_became_peered":"2023-07-29T17:09:08.806741+0000","last_unstale":"2023-07-29T17:09:10.637213+0000","last_undegraded":"2023-07-29T17:09:10.637213+0000","last_fullsized":"2023-07-29T17:09:10.637213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:51.706785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636331+0000","last_change":"2023-07-29T17:09:08.810210+0000","last_active":"2023-07-29T17:09:10.636331+0000","last_peered":"2023-07-29T17:09:10.636331+0000","last_clean":"2023-07-29T17:09:10.636331+0000","last_became_active":"2023-07-29T17:09:08.809533+0000","last_became_peered":"2023-07-29T17:09:08.809533+0000","last_unstale":"2023-07-29T17:09:10.636331+0000","last_undegraded":"2023-07-29T17:09:10.636331+0000","last_fullsized":"2023-07-29T17:09:10.636331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:16:24.171339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636321+0000","last_change":"2023-07-29T17:09:08.810363+0000","last_active":"2023-07-29T17:09:10.636321+0000","last_peered":"2023-07-29T17:09:10.636321+0000","last_clean":"2023-07-29T17:09:10.636321+0000","last_became_active":"2023-07-29T17:09:08.809081+0000","last_became_peered":"2023-07-29T17:09:08.809081+0000","last_unstale":"2023-07-29T17:09:10.636321+0000","last_undegraded":"2023-07-29T17:09:10.636321+0000","last_fullsized":"2023-07-29T17:09:10.636321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:32:25.073368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636234+0000","last_change":"2023-07-29T17:09:08.811330+0000","last_active":"2023-07-29T17:09:10.636234+0000","last_peered":"2023-07-29T17:09:10.636234+0000","last_clean":"2023-07-29T17:09:10.636234+0000","last_became_active":"2023-07-29T17:09:08.810135+0000","last_became_peered":"2023-07-29T17:09:08.810135+0000","last_unstale":"2023-07-29T17:09:10.636234+0000","last_undegraded":"2023-07-29T17:09:10.636234+0000","last_fullsized":"2023-07-29T17:09:10.636234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:48.534752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634403+0000","last_change":"2023-07-29T17:09:08.804867+0000","last_active":"2023-07-29T17:09:10.634403+0000","last_peered":"2023-07-29T17:09:10.634403+0000","last_clean":"2023-07-29T17:09:10.634403+0000","last_became_active":"2023-07-29T17:09:08.804222+0000","last_became_peered":"2023-07-29T17:09:08.804222+0000","last_unstale":"2023-07-29T17:09:10.634403+0000","last_undegraded":"2023-07-29T17:09:10.634403+0000","last_fullsized":"2023-07-29T17:09:10.634403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637360+0000","last_change":"2023-07-29T17:09:08.809856+0000","last_active":"2023-07-29T17:09:10.637360+0000","last_peered":"2023-07-29T17:09:10.637360+0000","last_clean":"2023-07-29T17:09:10.637360+0000","last_became_active":"2023-07-29T17:09:08.809105+0000","last_became_peered":"2023-07-29T17:09:08.809105+0000","last_unstale":"2023-07-29T17:09:10.637360+0000","last_undegraded":"2023-07-29T17:09:10.637360+0000","last_fullsized":"2023-07-29T17:09:10.637360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636511+0000","last_change":"2023-07-29T17:09:08.810595+0000","last_active":"2023-07-29T17:09:10.636511+0000","last_peered":"2023-07-29T17:09:10.636511+0000","last_clean":"2023-07-29T17:09:10.636511+0000","last_became_active":"2023-07-29T17:09:08.810022+0000","last_became_peered":"2023-07-29T17:09:08.810022+0000","last_unstale":"2023-07-29T17:09:10.636511+0000","last_undegraded":"2023-07-29T17:09:10.636511+0000","last_fullsized":"2023-07-29T17:09:10.636511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:32:58.063506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637234+0000","last_change":"2023-07-29T17:09:08.811893+0000","last_active":"2023-07-29T17:09:10.637234+0000","last_peered":"2023-07-29T17:09:10.637234+0000","last_clean":"2023-07-29T17:09:10.637234+0000","last_became_active":"2023-07-29T17:09:08.809728+0000","last_became_peered":"2023-07-29T17:09:08.809728+0000","last_unstale":"2023-07-29T17:09:10.637234+0000","last_undegraded":"2023-07-29T17:09:10.637234+0000","last_fullsized":"2023-07-29T17:09:10.637234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637184+0000","last_change":"2023-07-29T17:09:08.805902+0000","last_active":"2023-07-29T17:09:10.637184+0000","last_peered":"2023-07-29T17:09:10.637184+0000","last_clean":"2023-07-29T17:09:10.637184+0000","last_became_active":"2023-07-29T17:09:08.805304+0000","last_became_peered":"2023-07-29T17:09:08.805304+0000","last_unstale":"2023-07-29T17:09:10.637184+0000","last_undegraded":"2023-07-29T17:09:10.637184+0000","last_fullsized":"2023-07-29T17:09:10.637184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636378+0000","last_change":"2023-07-29T17:09:08.804148+0000","last_active":"2023-07-29T17:09:10.636378+0000","last_peered":"2023-07-29T17:09:10.636378+0000","last_clean":"2023-07-29T17:09:10.636378+0000","last_became_active":"2023-07-29T17:09:08.803777+0000","last_became_peered":"2023-07-29T17:09:08.803777+0000","last_unstale":"2023-07-29T17:09:10.636378+0000","last_undegraded":"2023-07-29T17:09:10.636378+0000","last_fullsized":"2023-07-29T17:09:10.636378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636312+0000","last_change":"2023-07-29T17:09:08.804335+0000","last_active":"2023-07-29T17:09:10.636312+0000","last_peered":"2023-07-29T17:09:10.636312+0000","last_clean":"2023-07-29T17:09:10.636312+0000","last_became_active":"2023-07-29T17:09:08.803973+0000","last_became_peered":"2023-07-29T17:09:08.803973+0000","last_unstale":"2023-07-29T17:09:10.636312+0000","last_undegraded":"2023-07-29T17:09:10.636312+0000","last_fullsized":"2023-07-29T17:09:10.636312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636249+0000","last_change":"2023-07-29T17:09:08.809453+0000","last_active":"2023-07-29T17:09:10.636249+0000","last_peered":"2023-07-29T17:09:10.636249+0000","last_clean":"2023-07-29T17:09:10.636249+0000","last_became_active":"2023-07-29T17:09:08.807946+0000","last_became_peered":"2023-07-29T17:09:08.807946+0000","last_unstale":"2023-07-29T17:09:10.636249+0000","last_undegraded":"2023-07-29T17:09:10.636249+0000","last_fullsized":"2023-07-29T17:09:10.636249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:11:58.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634417+0000","last_change":"2023-07-29T17:09:08.808488+0000","last_active":"2023-07-29T17:09:10.634417+0000","last_peered":"2023-07-29T17:09:10.634417+0000","last_clean":"2023-07-29T17:09:10.634417+0000","last_became_active":"2023-07-29T17:09:08.808278+0000","last_became_peered":"2023-07-29T17:09:08.808278+0000","last_unstale":"2023-07-29T17:09:10.634417+0000","last_undegraded":"2023-07-29T17:09:10.634417+0000","last_fullsized":"2023-07-29T17:09:10.634417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637376+0000","last_change":"2023-07-29T17:09:08.811217+0000","last_active":"2023-07-29T17:09:10.637376+0000","last_peered":"2023-07-29T17:09:10.637376+0000","last_clean":"2023-07-29T17:09:10.637376+0000","last_became_active":"2023-07-29T17:09:08.810159+0000","last_became_peered":"2023-07-29T17:09:08.810159+0000","last_unstale":"2023-07-29T17:09:10.637376+0000","last_undegraded":"2023-07-29T17:09:10.637376+0000","last_fullsized":"2023-07-29T17:09:10.637376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634344+0000","last_change":"2023-07-29T17:09:08.804579+0000","last_active":"2023-07-29T17:09:10.634344+0000","last_peered":"2023-07-29T17:09:10.634344+0000","last_clean":"2023-07-29T17:09:10.634344+0000","last_became_active":"2023-07-29T17:09:08.804096+0000","last_became_peered":"2023-07-29T17:09:08.804096+0000","last_unstale":"2023-07-29T17:09:10.634344+0000","last_undegraded":"2023-07-29T17:09:10.634344+0000","last_fullsized":"2023-07-29T17:09:10.634344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636491+0000","last_change":"2023-07-29T17:09:08.811586+0000","last_active":"2023-07-29T17:09:10.636491+0000","last_peered":"2023-07-29T17:09:10.636491+0000","last_clean":"2023-07-29T17:09:10.636491+0000","last_became_active":"2023-07-29T17:09:08.810175+0000","last_became_peered":"2023-07-29T17:09:08.810175+0000","last_unstale":"2023-07-29T17:09:10.636491+0000","last_undegraded":"2023-07-29T17:09:10.636491+0000","last_fullsized":"2023-07-29T17:09:10.636491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:56:45.427140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636393+0000","last_change":"2023-07-29T17:09:08.812676+0000","last_active":"2023-07-29T17:09:10.636393+0000","last_peered":"2023-07-29T17:09:10.636393+0000","last_clean":"2023-07-29T17:09:10.636393+0000","last_became_active":"2023-07-29T17:09:08.811651+0000","last_became_peered":"2023-07-29T17:09:08.811651+0000","last_unstale":"2023-07-29T17:09:10.636393+0000","last_undegraded":"2023-07-29T17:09:10.636393+0000","last_fullsized":"2023-07-29T17:09:10.636393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:54:31.664081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637155+0000","last_change":"2023-07-29T17:09:08.803272+0000","last_active":"2023-07-29T17:09:10.637155+0000","last_peered":"2023-07-29T17:09:10.637155+0000","last_clean":"2023-07-29T17:09:10.637155+0000","last_became_active":"2023-07-29T17:09:08.802901+0000","last_became_peered":"2023-07-29T17:09:08.802901+0000","last_unstale":"2023-07-29T17:09:10.637155+0000","last_undegraded":"2023-07-29T17:09:10.637155+0000","last_fullsized":"2023-07-29T17:09:10.637155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634229+0000","last_change":"2023-07-29T17:09:08.811564+0000","last_active":"2023-07-29T17:09:10.634229+0000","last_peered":"2023-07-29T17:09:10.634229+0000","last_clean":"2023-07-29T17:09:10.634229+0000","last_became_active":"2023-07-29T17:09:08.811369+0000","last_became_peered":"2023-07-29T17:09:08.811369+0000","last_unstale":"2023-07-29T17:09:10.634229+0000","last_undegraded":"2023-07-29T17:09:10.634229+0000","last_fullsized":"2023-07-29T17:09:10.634229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637043+0000","last_change":"2023-07-29T17:09:08.806399+0000","last_active":"2023-07-29T17:09:10.637043+0000","last_peered":"2023-07-29T17:09:10.637043+0000","last_clean":"2023-07-29T17:09:10.637043+0000","last_became_active":"2023-07-29T17:09:08.805387+0000","last_became_peered":"2023-07-29T17:09:08.805387+0000","last_unstale":"2023-07-29T17:09:10.637043+0000","last_undegraded":"2023-07-29T17:09:10.637043+0000","last_fullsized":"2023-07-29T17:09:10.637043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:08:32.766520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637400+0000","last_change":"2023-07-29T17:09:08.811836+0000","last_active":"2023-07-29T17:09:10.637400+0000","last_peered":"2023-07-29T17:09:10.637400+0000","last_clean":"2023-07-29T17:09:10.637400+0000","last_became_active":"2023-07-29T17:09:08.810204+0000","last_became_peered":"2023-07-29T17:09:08.810204+0000","last_unstale":"2023-07-29T17:09:10.637400+0000","last_undegraded":"2023-07-29T17:09:10.637400+0000","last_fullsized":"2023-07-29T17:09:10.637400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634395+0000","last_change":"2023-07-29T17:09:08.813794+0000","last_active":"2023-07-29T17:09:10.634395+0000","last_peered":"2023-07-29T17:09:10.634395+0000","last_clean":"2023-07-29T17:09:10.634395+0000","last_became_active":"2023-07-29T17:09:08.813439+0000","last_became_peered":"2023-07-29T17:09:08.813439+0000","last_unstale":"2023-07-29T17:09:10.634395+0000","last_undegraded":"2023-07-29T17:09:10.634395+0000","last_fullsized":"2023-07-29T17:09:10.634395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636520+0000","last_change":"2023-07-29T17:09:08.807967+0000","last_active":"2023-07-29T17:09:10.636520+0000","last_peered":"2023-07-29T17:09:10.636520+0000","last_clean":"2023-07-29T17:09:10.636520+0000","last_became_active":"2023-07-29T17:09:08.806937+0000","last_became_peered":"2023-07-29T17:09:08.806937+0000","last_unstale":"2023-07-29T17:09:10.636520+0000","last_undegraded":"2023-07-29T17:09:10.636520+0000","last_fullsized":"2023-07-29T17:09:10.636520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637142+0000","last_change":"2023-07-29T17:09:08.418140+0000","last_active":"2023-07-29T17:09:10.637142+0000","last_peered":"2023-07-29T17:09:10.637142+0000","last_clean":"2023-07-29T17:09:10.637142+0000","last_became_active":"2023-07-29T17:09:08.417300+0000","last_became_peered":"2023-07-29T17:09:08.417300+0000","last_unstale":"2023-07-29T17:09:10.637142+0000","last_undegraded":"2023-07-29T17:09:10.637142+0000","last_fullsized":"2023-07-29T17:09:10.637142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:10:56.774292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637325+0000","last_change":"2023-07-29T17:09:08.810512+0000","last_active":"2023-07-29T17:09:10.637325+0000","last_peered":"2023-07-29T17:09:10.637325+0000","last_clean":"2023-07-29T17:09:10.637325+0000","last_became_active":"2023-07-29T17:09:08.809771+0000","last_became_peered":"2023-07-29T17:09:08.809771+0000","last_unstale":"2023-07-29T17:09:10.637325+0000","last_undegraded":"2023-07-29T17:09:10.637325+0000","last_fullsized":"2023-07-29T17:09:10.637325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634236+0000","last_change":"2023-07-29T17:09:08.418941+0000","last_active":"2023-07-29T17:09:10.634236+0000","last_peered":"2023-07-29T17:09:10.634236+0000","last_clean":"2023-07-29T17:09:10.634236+0000","last_became_active":"2023-07-29T17:09:08.418456+0000","last_became_peered":"2023-07-29T17:09:08.418456+0000","last_unstale":"2023-07-29T17:09:10.634236+0000","last_undegraded":"2023-07-29T17:09:10.634236+0000","last_fullsized":"2023-07-29T17:09:10.634236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634376+0000","last_change":"2023-07-29T17:09:08.813565+0000","last_active":"2023-07-29T17:09:10.634376+0000","last_peered":"2023-07-29T17:09:10.634376+0000","last_clean":"2023-07-29T17:09:10.634376+0000","last_became_active":"2023-07-29T17:09:08.813192+0000","last_became_peered":"2023-07-29T17:09:08.813192+0000","last_unstale":"2023-07-29T17:09:10.634376+0000","last_undegraded":"2023-07-29T17:09:10.634376+0000","last_fullsized":"2023-07-29T17:09:10.634376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634197+0000","last_change":"2023-07-29T17:09:08.413774+0000","last_active":"2023-07-29T17:09:10.634197+0000","last_peered":"2023-07-29T17:09:10.634197+0000","last_clean":"2023-07-29T17:09:10.634197+0000","last_became_active":"2023-07-29T17:09:08.413034+0000","last_became_peered":"2023-07-29T17:09:08.413034+0000","last_unstale":"2023-07-29T17:09:10.634197+0000","last_undegraded":"2023-07-29T17:09:10.634197+0000","last_fullsized":"2023-07-29T17:09:10.634197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637391+0000","last_change":"2023-07-29T17:09:08.811823+0000","last_active":"2023-07-29T17:09:10.637391+0000","last_peered":"2023-07-29T17:09:10.637391+0000","last_clean":"2023-07-29T17:09:10.637391+0000","last_became_active":"2023-07-29T17:09:08.810992+0000","last_became_peered":"2023-07-29T17:09:08.810992+0000","last_unstale":"2023-07-29T17:09:10.637391+0000","last_undegraded":"2023-07-29T17:09:10.637391+0000","last_fullsized":"2023-07-29T17:09:10.637391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634457+0000","last_change":"2023-07-29T17:09:08.418582+0000","last_active":"2023-07-29T17:09:10.634457+0000","last_peered":"2023-07-29T17:09:10.634457+0000","last_clean":"2023-07-29T17:09:10.634457+0000","last_became_active":"2023-07-29T17:09:08.418147+0000","last_became_peered":"2023-07-29T17:09:08.418147+0000","last_unstale":"2023-07-29T17:09:10.634457+0000","last_undegraded":"2023-07-29T17:09:10.634457+0000","last_fullsized":"2023-07-29T17:09:10.634457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634176+0000","last_change":"2023-07-29T17:09:08.803940+0000","last_active":"2023-07-29T17:09:10.634176+0000","last_peered":"2023-07-29T17:09:10.634176+0000","last_clean":"2023-07-29T17:09:10.634176+0000","last_became_active":"2023-07-29T17:09:08.803232+0000","last_became_peered":"2023-07-29T17:09:08.803232+0000","last_unstale":"2023-07-29T17:09:10.634176+0000","last_undegraded":"2023-07-29T17:09:10.634176+0000","last_fullsized":"2023-07-29T17:09:10.634176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:20:30.530779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636584+0000","last_change":"2023-07-29T17:09:08.419607+0000","last_active":"2023-07-29T17:09:10.636584+0000","last_peered":"2023-07-29T17:09:10.636584+0000","last_clean":"2023-07-29T17:09:10.636584+0000","last_became_active":"2023-07-29T17:09:08.418588+0000","last_became_peered":"2023-07-29T17:09:08.418588+0000","last_unstale":"2023-07-29T17:09:10.636584+0000","last_undegraded":"2023-07-29T17:09:10.636584+0000","last_fullsized":"2023-07-29T17:09:10.636584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634244+0000","last_change":"2023-07-29T17:09:08.813897+0000","last_active":"2023-07-29T17:09:10.634244+0000","last_peered":"2023-07-29T17:09:10.634244+0000","last_clean":"2023-07-29T17:09:10.634244+0000","last_became_active":"2023-07-29T17:09:08.813571+0000","last_became_peered":"2023-07-29T17:09:08.813571+0000","last_unstale":"2023-07-29T17:09:10.634244+0000","last_undegraded":"2023-07-29T17:09:10.634244+0000","last_fullsized":"2023-07-29T17:09:10.634244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637273+0000","last_change":"2023-07-29T17:09:08.418771+0000","last_active":"2023-07-29T17:09:10.637273+0000","last_peered":"2023-07-29T17:09:10.637273+0000","last_clean":"2023-07-29T17:09:10.637273+0000","last_became_active":"2023-07-29T17:09:08.418416+0000","last_became_peered":"2023-07-29T17:09:08.418416+0000","last_unstale":"2023-07-29T17:09:10.637273+0000","last_undegraded":"2023-07-29T17:09:10.637273+0000","last_fullsized":"2023-07-29T17:09:10.637273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634268+0000","last_change":"2023-07-29T17:09:08.808472+0000","last_active":"2023-07-29T17:09:10.634268+0000","last_peered":"2023-07-29T17:09:10.634268+0000","last_clean":"2023-07-29T17:09:10.634268+0000","last_became_active":"2023-07-29T17:09:08.808269+0000","last_became_peered":"2023-07-29T17:09:08.808269+0000","last_unstale":"2023-07-29T17:09:10.634268+0000","last_undegraded":"2023-07-29T17:09:10.634268+0000","last_fullsized":"2023-07-29T17:09:10.634268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636482+0000","last_change":"2023-07-29T17:09:08.421127+0000","last_active":"2023-07-29T17:09:10.636482+0000","last_peered":"2023-07-29T17:09:10.636482+0000","last_clean":"2023-07-29T17:09:10.636482+0000","last_became_active":"2023-07-29T17:09:08.420191+0000","last_became_peered":"2023-07-29T17:09:08.420191+0000","last_unstale":"2023-07-29T17:09:10.636482+0000","last_undegraded":"2023-07-29T17:09:10.636482+0000","last_fullsized":"2023-07-29T17:09:10.636482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:12:28.282776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636438+0000","last_change":"2023-07-29T17:09:08.805593+0000","last_active":"2023-07-29T17:09:10.636438+0000","last_peered":"2023-07-29T17:09:10.636438+0000","last_clean":"2023-07-29T17:09:10.636438+0000","last_became_active":"2023-07-29T17:09:08.803911+0000","last_became_peered":"2023-07-29T17:09:08.803911+0000","last_unstale":"2023-07-29T17:09:10.636438+0000","last_undegraded":"2023-07-29T17:09:10.636438+0000","last_fullsized":"2023-07-29T17:09:10.636438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636429+0000","last_change":"2023-07-29T17:09:08.421237+0000","last_active":"2023-07-29T17:09:10.636429+0000","last_peered":"2023-07-29T17:09:10.636429+0000","last_clean":"2023-07-29T17:09:10.636429+0000","last_became_active":"2023-07-29T17:09:08.420880+0000","last_became_peered":"2023-07-29T17:09:08.420880+0000","last_unstale":"2023-07-29T17:09:10.636429+0000","last_undegraded":"2023-07-29T17:09:10.636429+0000","last_fullsized":"2023-07-29T17:09:10.636429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637243+0000","last_change":"2023-07-29T17:09:08.805497+0000","last_active":"2023-07-29T17:09:10.637243+0000","last_peered":"2023-07-29T17:09:10.637243+0000","last_clean":"2023-07-29T17:09:10.637243+0000","last_became_active":"2023-07-29T17:09:08.805091+0000","last_became_peered":"2023-07-29T17:09:08.805091+0000","last_unstale":"2023-07-29T17:09:10.637243+0000","last_undegraded":"2023-07-29T17:09:10.637243+0000","last_fullsized":"2023-07-29T17:09:10.637243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634277+0000","last_change":"2023-07-29T17:09:08.418753+0000","last_active":"2023-07-29T17:09:10.634277+0000","last_peered":"2023-07-29T17:09:10.634277+0000","last_clean":"2023-07-29T17:09:10.634277+0000","last_became_active":"2023-07-29T17:09:08.418185+0000","last_became_peered":"2023-07-29T17:09:08.418185+0000","last_unstale":"2023-07-29T17:09:10.634277+0000","last_undegraded":"2023-07-29T17:09:10.634277+0000","last_fullsized":"2023-07-29T17:09:10.634277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637317+0000","last_change":"2023-07-29T17:09:08.805983+0000","last_active":"2023-07-29T17:09:10.637317+0000","last_peered":"2023-07-29T17:09:10.637317+0000","last_clean":"2023-07-29T17:09:10.637317+0000","last_became_active":"2023-07-29T17:09:08.805216+0000","last_became_peered":"2023-07-29T17:09:08.805216+0000","last_unstale":"2023-07-29T17:09:10.637317+0000","last_undegraded":"2023-07-29T17:09:10.637317+0000","last_fullsized":"2023-07-29T17:09:10.637317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:09:41.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637062+0000","last_change":"2023-07-29T17:09:08.418372+0000","last_active":"2023-07-29T17:09:10.637062+0000","last_peered":"2023-07-29T17:09:10.637062+0000","last_clean":"2023-07-29T17:09:10.637062+0000","last_became_active":"2023-07-29T17:09:08.417106+0000","last_became_peered":"2023-07-29T17:09:08.417106+0000","last_unstale":"2023-07-29T17:09:10.637062+0000","last_undegraded":"2023-07-29T17:09:10.637062+0000","last_fullsized":"2023-07-29T17:09:10.637062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:11:10.954172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634359+0000","last_change":"2023-07-29T17:09:08.804460+0000","last_active":"2023-07-29T17:09:10.634359+0000","last_peered":"2023-07-29T17:09:10.634359+0000","last_clean":"2023-07-29T17:09:10.634359+0000","last_became_active":"2023-07-29T17:09:08.804053+0000","last_became_peered":"2023-07-29T17:09:08.804053+0000","last_unstale":"2023-07-29T17:09:10.634359+0000","last_undegraded":"2023-07-29T17:09:10.634359+0000","last_fullsized":"2023-07-29T17:09:10.634359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:09:06.439498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636282+0000","last_change":"2023-07-29T17:09:08.421136+0000","last_active":"2023-07-29T17:09:10.636282+0000","last_peered":"2023-07-29T17:09:10.636282+0000","last_clean":"2023-07-29T17:09:10.636282+0000","last_became_active":"2023-07-29T17:09:08.420028+0000","last_became_peered":"2023-07-29T17:09:08.420028+0000","last_unstale":"2023-07-29T17:09:10.636282+0000","last_undegraded":"2023-07-29T17:09:10.636282+0000","last_fullsized":"2023-07-29T17:09:10.636282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:18:27.069243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634474+0000","last_change":"2023-07-29T17:09:08.813926+0000","last_active":"2023-07-29T17:09:10.634474+0000","last_peered":"2023-07-29T17:09:10.634474+0000","last_clean":"2023-07-29T17:09:10.634474+0000","last_became_active":"2023-07-29T17:09:08.813432+0000","last_became_peered":"2023-07-29T17:09:08.813432+0000","last_unstale":"2023-07-29T17:09:10.634474+0000","last_undegraded":"2023-07-29T17:09:10.634474+0000","last_fullsized":"2023-07-29T17:09:10.634474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636604+0000","last_change":"2023-07-29T17:09:08.419765+0000","last_active":"2023-07-29T17:09:10.636604+0000","last_peered":"2023-07-29T17:09:10.636604+0000","last_clean":"2023-07-29T17:09:10.636604+0000","last_became_active":"2023-07-29T17:09:08.419295+0000","last_became_peered":"2023-07-29T17:09:08.419295+0000","last_unstale":"2023-07-29T17:09:10.636604+0000","last_undegraded":"2023-07-29T17:09:10.636604+0000","last_fullsized":"2023-07-29T17:09:10.636604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:30.304647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637004+0000","last_change":"2023-07-29T17:09:08.811228+0000","last_active":"2023-07-29T17:09:10.637004+0000","last_peered":"2023-07-29T17:09:10.637004+0000","last_clean":"2023-07-29T17:09:10.637004+0000","last_became_active":"2023-07-29T17:09:08.810693+0000","last_became_peered":"2023-07-29T17:09:08.810693+0000","last_unstale":"2023-07-29T17:09:10.637004+0000","last_undegraded":"2023-07-29T17:09:10.637004+0000","last_fullsized":"2023-07-29T17:09:10.637004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637350+0000","last_change":"2023-07-29T17:09:08.418661+0000","last_active":"2023-07-29T17:09:10.637350+0000","last_peered":"2023-07-29T17:09:10.637350+0000","last_clean":"2023-07-29T17:09:10.637350+0000","last_became_active":"2023-07-29T17:09:08.417552+0000","last_became_peered":"2023-07-29T17:09:08.417552+0000","last_unstale":"2023-07-29T17:09:10.637350+0000","last_undegraded":"2023-07-29T17:09:10.637350+0000","last_fullsized":"2023-07-29T17:09:10.637350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:49:07.023200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637109+0000","last_change":"2023-07-29T17:09:08.805789+0000","last_active":"2023-07-29T17:09:10.637109+0000","last_peered":"2023-07-29T17:09:10.637109+0000","last_clean":"2023-07-29T17:09:10.637109+0000","last_became_active":"2023-07-29T17:09:08.805180+0000","last_became_peered":"2023-07-29T17:09:08.805180+0000","last_unstale":"2023-07-29T17:09:10.637109+0000","last_undegraded":"2023-07-29T17:09:10.637109+0000","last_fullsized":"2023-07-29T17:09:10.637109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:15:35.515233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636531+0000","last_change":"2023-07-29T17:09:08.421053+0000","last_active":"2023-07-29T17:09:10.636531+0000","last_peered":"2023-07-29T17:09:10.636531+0000","last_clean":"2023-07-29T17:09:10.636531+0000","last_became_active":"2023-07-29T17:09:08.420321+0000","last_became_peered":"2023-07-29T17:09:08.420321+0000","last_unstale":"2023-07-29T17:09:10.636531+0000","last_undegraded":"2023-07-29T17:09:10.636531+0000","last_fullsized":"2023-07-29T17:09:10.636531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636365+0000","last_change":"2023-07-29T17:09:08.806845+0000","last_active":"2023-07-29T17:09:10.636365+0000","last_peered":"2023-07-29T17:09:10.636365+0000","last_clean":"2023-07-29T17:09:10.636365+0000","last_became_active":"2023-07-29T17:09:08.806497+0000","last_became_peered":"2023-07-29T17:09:08.806497+0000","last_unstale":"2023-07-29T17:09:10.636365+0000","last_undegraded":"2023-07-29T17:09:10.636365+0000","last_fullsized":"2023-07-29T17:09:10.636365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:00:48.566504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636448+0000","last_change":"2023-07-29T17:09:08.420849+0000","last_active":"2023-07-29T17:09:10.636448+0000","last_peered":"2023-07-29T17:09:10.636448+0000","last_clean":"2023-07-29T17:09:10.636448+0000","last_became_active":"2023-07-29T17:09:08.419721+0000","last_became_peered":"2023-07-29T17:09:08.419721+0000","last_unstale":"2023-07-29T17:09:10.636448+0000","last_undegraded":"2023-07-29T17:09:10.636448+0000","last_fullsized":"2023-07-29T17:09:10.636448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:19:00.268741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634298+0000","last_change":"2023-07-29T17:09:08.813905+0000","last_active":"2023-07-29T17:09:10.634298+0000","last_peered":"2023-07-29T17:09:10.634298+0000","last_clean":"2023-07-29T17:09:10.634298+0000","last_became_active":"2023-07-29T17:09:08.813445+0000","last_became_peered":"2023-07-29T17:09:08.813445+0000","last_unstale":"2023-07-29T17:09:10.634298+0000","last_undegraded":"2023-07-29T17:09:10.634298+0000","last_fullsized":"2023-07-29T17:09:10.634298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634288+0000","last_change":"2023-07-29T17:09:08.418746+0000","last_active":"2023-07-29T17:09:10.634288+0000","last_peered":"2023-07-29T17:09:10.634288+0000","last_clean":"2023-07-29T17:09:10.634288+0000","last_became_active":"2023-07-29T17:09:08.418119+0000","last_became_peered":"2023-07-29T17:09:08.418119+0000","last_unstale":"2023-07-29T17:09:10.634288+0000","last_undegraded":"2023-07-29T17:09:10.634288+0000","last_fullsized":"2023-07-29T17:09:10.634288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636457+0000","last_change":"2023-07-29T17:09:08.810713+0000","last_active":"2023-07-29T17:09:10.636457+0000","last_peered":"2023-07-29T17:09:10.636457+0000","last_clean":"2023-07-29T17:09:10.636457+0000","last_became_active":"2023-07-29T17:09:08.809222+0000","last_became_peered":"2023-07-29T17:09:08.809222+0000","last_unstale":"2023-07-29T17:09:10.636457+0000","last_undegraded":"2023-07-29T17:09:10.636457+0000","last_fullsized":"2023-07-29T17:09:10.636457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636340+0000","last_change":"2023-07-29T17:09:08.421082+0000","last_active":"2023-07-29T17:09:10.636340+0000","last_peered":"2023-07-29T17:09:10.636340+0000","last_clean":"2023-07-29T17:09:10.636340+0000","last_became_active":"2023-07-29T17:09:08.420336+0000","last_became_peered":"2023-07-29T17:09:08.420336+0000","last_unstale":"2023-07-29T17:09:10.636340+0000","last_undegraded":"2023-07-29T17:09:10.636340+0000","last_fullsized":"2023-07-29T17:09:10.636340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:09.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636574+0000","last_change":"2023-07-29T17:09:08.807018+0000","last_active":"2023-07-29T17:09:10.636574+0000","last_peered":"2023-07-29T17:09:10.636574+0000","last_clean":"2023-07-29T17:09:10.636574+0000","last_became_active":"2023-07-29T17:09:08.805202+0000","last_became_peered":"2023-07-29T17:09:08.805202+0000","last_unstale":"2023-07-29T17:09:10.636574+0000","last_undegraded":"2023-07-29T17:09:10.636574+0000","last_fullsized":"2023-07-29T17:09:10.636574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:55:16.999338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637052+0000","last_change":"2023-07-29T17:09:08.418615+0000","last_active":"2023-07-29T17:09:10.637052+0000","last_peered":"2023-07-29T17:09:10.637052+0000","last_clean":"2023-07-29T17:09:10.637052+0000","last_became_active":"2023-07-29T17:09:08.418109+0000","last_became_peered":"2023-07-29T17:09:08.418109+0000","last_unstale":"2023-07-29T17:09:10.637052+0000","last_undegraded":"2023-07-29T17:09:10.637052+0000","last_fullsized":"2023-07-29T17:09:10.637052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:05.688784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636594+0000","last_change":"2023-07-29T17:09:08.805465+0000","last_active":"2023-07-29T17:09:10.636594+0000","last_peered":"2023-07-29T17:09:10.636594+0000","last_clean":"2023-07-29T17:09:10.636594+0000","last_became_active":"2023-07-29T17:09:08.804210+0000","last_became_peered":"2023-07-29T17:09:08.804210+0000","last_unstale":"2023-07-29T17:09:10.636594+0000","last_undegraded":"2023-07-29T17:09:10.636594+0000","last_fullsized":"2023-07-29T17:09:10.636594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:29:50.202034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637033+0000","last_change":"2023-07-29T17:09:08.418245+0000","last_active":"2023-07-29T17:09:10.637033+0000","last_peered":"2023-07-29T17:09:10.637033+0000","last_clean":"2023-07-29T17:09:10.637033+0000","last_became_active":"2023-07-29T17:09:08.417357+0000","last_became_peered":"2023-07-29T17:09:08.417357+0000","last_unstale":"2023-07-29T17:09:10.637033+0000","last_undegraded":"2023-07-29T17:09:10.637033+0000","last_fullsized":"2023-07-29T17:09:10.637033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:46:16.558460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634436+0000","last_change":"2023-07-29T17:09:08.809821+0000","last_active":"2023-07-29T17:09:10.634436+0000","last_peered":"2023-07-29T17:09:10.634436+0000","last_clean":"2023-07-29T17:09:10.634436+0000","last_became_active":"2023-07-29T17:09:08.809412+0000","last_became_peered":"2023-07-29T17:09:08.809412+0000","last_unstale":"2023-07-29T17:09:10.634436+0000","last_undegraded":"2023-07-29T17:09:10.634436+0000","last_fullsized":"2023-07-29T17:09:10.634436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799903+0000","last_change":"2023-07-29T17:09:03.390983+0000","last_active":"2023-07-29T17:09:09.799903+0000","last_peered":"2023-07-29T17:09:09.799903+0000","last_clean":"2023-07-29T17:09:09.799903+0000","last_became_active":"2023-07-29T17:09:03.390525+0000","last_became_peered":"2023-07-29T17:09:03.390525+0000","last_unstale":"2023-07-29T17:09:09.799903+0000","last_undegraded":"2023-07-29T17:09:09.799903+0000","last_fullsized":"2023-07-29T17:09:09.799903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:34:43.298202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636555+0000","last_change":"2023-07-29T17:09:08.421277+0000","last_active":"2023-07-29T17:09:10.636555+0000","last_peered":"2023-07-29T17:09:10.636555+0000","last_clean":"2023-07-29T17:09:10.636555+0000","last_became_active":"2023-07-29T17:09:08.420787+0000","last_became_peered":"2023-07-29T17:09:08.420787+0000","last_unstale":"2023-07-29T17:09:10.636555+0000","last_undegraded":"2023-07-29T17:09:10.636555+0000","last_fullsized":"2023-07-29T17:09:10.636555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637165+0000","last_change":"2023-07-29T17:09:08.807897+0000","last_active":"2023-07-29T17:09:10.637165+0000","last_peered":"2023-07-29T17:09:10.637165+0000","last_clean":"2023-07-29T17:09:10.637165+0000","last_became_active":"2023-07-29T17:09:08.807553+0000","last_became_peered":"2023-07-29T17:09:08.807553+0000","last_unstale":"2023-07-29T17:09:10.637165+0000","last_undegraded":"2023-07-29T17:09:10.637165+0000","last_fullsized":"2023-07-29T17:09:10.637165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:04:50.919649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803038+0000","last_change":"2023-07-29T17:09:03.392903+0000","last_active":"2023-07-29T17:09:09.803038+0000","last_peered":"2023-07-29T17:09:09.803038+0000","last_clean":"2023-07-29T17:09:09.803038+0000","last_became_active":"2023-07-29T17:09:03.392667+0000","last_became_peered":"2023-07-29T17:09:03.392667+0000","last_unstale":"2023-07-29T17:09:09.803038+0000","last_undegraded":"2023-07-29T17:09:09.803038+0000","last_fullsized":"2023-07-29T17:09:09.803038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:18:06.563883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636413+0000","last_change":"2023-07-29T17:09:08.421002+0000","last_active":"2023-07-29T17:09:10.636413+0000","last_peered":"2023-07-29T17:09:10.636413+0000","last_clean":"2023-07-29T17:09:10.636413+0000","last_became_active":"2023-07-29T17:09:08.420284+0000","last_became_peered":"2023-07-29T17:09:08.420284+0000","last_unstale":"2023-07-29T17:09:10.636413+0000","last_undegraded":"2023-07-29T17:09:10.636413+0000","last_fullsized":"2023-07-29T17:09:10.636413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:37:01.958207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634315+0000","last_change":"2023-07-29T17:09:08.804406+0000","last_active":"2023-07-29T17:09:10.634315+0000","last_peered":"2023-07-29T17:09:10.634315+0000","last_clean":"2023-07-29T17:09:10.634315+0000","last_became_active":"2023-07-29T17:09:08.804044+0000","last_became_peered":"2023-07-29T17:09:08.804044+0000","last_unstale":"2023-07-29T17:09:10.634315+0000","last_undegraded":"2023-07-29T17:09:10.634315+0000","last_fullsized":"2023-07-29T17:09:10.634315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:17:39.071397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.799562+0000","last_change":"2023-07-29T17:09:03.390882+0000","last_active":"2023-07-29T17:09:09.799562+0000","last_peered":"2023-07-29T17:09:09.799562+0000","last_clean":"2023-07-29T17:09:09.799562+0000","last_became_active":"2023-07-29T17:09:03.390330+0000","last_became_peered":"2023-07-29T17:09:03.390330+0000","last_unstale":"2023-07-29T17:09:09.799562+0000","last_undegraded":"2023-07-29T17:09:09.799562+0000","last_fullsized":"2023-07-29T17:09:09.799562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:07:25.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637022+0000","last_change":"2023-07-29T17:09:08.417617+0000","last_active":"2023-07-29T17:09:10.637022+0000","last_peered":"2023-07-29T17:09:10.637022+0000","last_clean":"2023-07-29T17:09:10.637022+0000","last_became_active":"2023-07-29T17:09:08.417121+0000","last_became_peered":"2023-07-29T17:09:08.417121+0000","last_unstale":"2023-07-29T17:09:10.637022+0000","last_undegraded":"2023-07-29T17:09:10.637022+0000","last_fullsized":"2023-07-29T17:09:10.637022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634465+0000","last_change":"2023-07-29T17:09:08.809924+0000","last_active":"2023-07-29T17:09:10.634465+0000","last_peered":"2023-07-29T17:09:10.634465+0000","last_clean":"2023-07-29T17:09:10.634465+0000","last_became_active":"2023-07-29T17:09:08.809417+0000","last_became_peered":"2023-07-29T17:09:08.809417+0000","last_unstale":"2023-07-29T17:09:10.634465+0000","last_undegraded":"2023-07-29T17:09:10.634465+0000","last_fullsized":"2023-07-29T17:09:10.634465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:09:46.266985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802887+0000","last_change":"2023-07-29T17:09:03.390489+0000","last_active":"2023-07-29T17:09:09.802887+0000","last_peered":"2023-07-29T17:09:09.802887+0000","last_clean":"2023-07-29T17:09:09.802887+0000","last_became_active":"2023-07-29T17:09:03.390186+0000","last_became_peered":"2023-07-29T17:09:03.390186+0000","last_unstale":"2023-07-29T17:09:09.802887+0000","last_undegraded":"2023-07-29T17:09:09.802887+0000","last_fullsized":"2023-07-29T17:09:09.802887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:49:43.993834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802229+0000","last_change":"2023-07-29T17:08:58.368085+0000","last_active":"2023-07-29T17:09:09.802229+0000","last_peered":"2023-07-29T17:09:09.802229+0000","last_clean":"2023-07-29T17:09:09.802229+0000","last_became_active":"2023-07-29T17:08:58.367806+0000","last_became_peered":"2023-07-29T17:08:58.367806+0000","last_unstale":"2023-07-29T17:09:09.802229+0000","last_undegraded":"2023-07-29T17:09:09.802229+0000","last_fullsized":"2023-07-29T17:09:09.802229+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:08:57.356397+0000","last_clean_scrub_stamp":"2023-07-29T17:08:57.356397+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:29:06.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634254+0000","last_change":"2023-07-29T17:09:08.414301+0000","last_active":"2023-07-29T17:09:10.634254+0000","last_peered":"2023-07-29T17:09:10.634254+0000","last_clean":"2023-07-29T17:09:10.634254+0000","last_became_active":"2023-07-29T17:09:08.413907+0000","last_became_peered":"2023-07-29T17:09:08.413907+0000","last_unstale":"2023-07-29T17:09:10.634254+0000","last_undegraded":"2023-07-29T17:09:10.634254+0000","last_fullsized":"2023-07-29T17:09:10.634254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:38:49.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636564+0000","last_change":"2023-07-29T17:09:08.807744+0000","last_active":"2023-07-29T17:09:10.636564+0000","last_peered":"2023-07-29T17:09:10.636564+0000","last_clean":"2023-07-29T17:09:10.636564+0000","last_became_active":"2023-07-29T17:09:08.805397+0000","last_became_peered":"2023-07-29T17:09:08.805397+0000","last_unstale":"2023-07-29T17:09:10.636564+0000","last_undegraded":"2023-07-29T17:09:10.636564+0000","last_fullsized":"2023-07-29T17:09:10.636564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:56:02.168832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.802275+0000","last_change":"2023-07-29T17:09:03.391011+0000","last_active":"2023-07-29T17:09:09.802275+0000","last_peered":"2023-07-29T17:09:09.802275+0000","last_clean":"2023-07-29T17:09:09.802275+0000","last_became_active":"2023-07-29T17:09:03.390771+0000","last_became_peered":"2023-07-29T17:09:03.390771+0000","last_unstale":"2023-07-29T17:09:09.802275+0000","last_undegraded":"2023-07-29T17:09:09.802275+0000","last_fullsized":"2023-07-29T17:09:09.802275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:28:36.799100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634208+0000","last_change":"2023-07-29T17:09:08.418114+0000","last_active":"2023-07-29T17:09:10.634208+0000","last_peered":"2023-07-29T17:09:10.634208+0000","last_clean":"2023-07-29T17:09:10.634208+0000","last_became_active":"2023-07-29T17:09:08.417711+0000","last_became_peered":"2023-07-29T17:09:08.417711+0000","last_unstale":"2023-07-29T17:09:10.634208+0000","last_undegraded":"2023-07-29T17:09:10.634208+0000","last_fullsized":"2023-07-29T17:09:10.634208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:16.346579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637368+0000","last_change":"2023-07-29T17:09:08.807826+0000","last_active":"2023-07-29T17:09:10.637368+0000","last_peered":"2023-07-29T17:09:10.637368+0000","last_clean":"2023-07-29T17:09:10.637368+0000","last_became_active":"2023-07-29T17:09:08.806981+0000","last_became_peered":"2023-07-29T17:09:08.806981+0000","last_unstale":"2023-07-29T17:09:10.637368+0000","last_undegraded":"2023-07-29T17:09:10.637368+0000","last_fullsized":"2023-07-29T17:09:10.637368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:09:54.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803055+0000","last_change":"2023-07-29T17:09:03.390493+0000","last_active":"2023-07-29T17:09:09.803055+0000","last_peered":"2023-07-29T17:09:09.803055+0000","last_clean":"2023-07-29T17:09:09.803055+0000","last_became_active":"2023-07-29T17:09:03.390177+0000","last_became_peered":"2023-07-29T17:09:03.390177+0000","last_unstale":"2023-07-29T17:09:09.803055+0000","last_undegraded":"2023-07-29T17:09:09.803055+0000","last_fullsized":"2023-07-29T17:09:09.803055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:46:32.855458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634329+0000","last_change":"2023-07-29T17:09:08.414527+0000","last_active":"2023-07-29T17:09:10.634329+0000","last_peered":"2023-07-29T17:09:10.634329+0000","last_clean":"2023-07-29T17:09:10.634329+0000","last_became_active":"2023-07-29T17:09:08.414112+0000","last_became_peered":"2023-07-29T17:09:08.414112+0000","last_unstale":"2023-07-29T17:09:10.634329+0000","last_undegraded":"2023-07-29T17:09:10.634329+0000","last_fullsized":"2023-07-29T17:09:10.634329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:49:13.389280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637224+0000","last_change":"2023-07-29T17:09:08.809809+0000","last_active":"2023-07-29T17:09:10.637224+0000","last_peered":"2023-07-29T17:09:10.637224+0000","last_clean":"2023-07-29T17:09:10.637224+0000","last_became_active":"2023-07-29T17:09:08.809054+0000","last_became_peered":"2023-07-29T17:09:08.809054+0000","last_unstale":"2023-07-29T17:09:10.637224+0000","last_undegraded":"2023-07-29T17:09:10.637224+0000","last_fullsized":"2023-07-29T17:09:10.637224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:33.348641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634426+0000","last_change":"2023-07-29T17:09:08.414619+0000","last_active":"2023-07-29T17:09:10.634426+0000","last_peered":"2023-07-29T17:09:10.634426+0000","last_clean":"2023-07-29T17:09:10.634426+0000","last_became_active":"2023-07-29T17:09:08.414300+0000","last_became_peered":"2023-07-29T17:09:08.414300+0000","last_unstale":"2023-07-29T17:09:10.634426+0000","last_undegraded":"2023-07-29T17:09:10.634426+0000","last_fullsized":"2023-07-29T17:09:10.634426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:56.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.800287+0000","last_change":"2023-07-29T17:09:03.390858+0000","last_active":"2023-07-29T17:09:09.800287+0000","last_peered":"2023-07-29T17:09:09.800287+0000","last_clean":"2023-07-29T17:09:09.800287+0000","last_became_active":"2023-07-29T17:09:03.390410+0000","last_became_peered":"2023-07-29T17:09:03.390410+0000","last_unstale":"2023-07-29T17:09:09.800287+0000","last_undegraded":"2023-07-29T17:09:09.800287+0000","last_fullsized":"2023-07-29T17:09:09.800287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:15:34.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634153+0000","last_change":"2023-07-29T17:09:08.810603+0000","last_active":"2023-07-29T17:09:10.634153+0000","last_peered":"2023-07-29T17:09:10.634153+0000","last_clean":"2023-07-29T17:09:10.634153+0000","last_became_active":"2023-07-29T17:09:08.810158+0000","last_became_peered":"2023-07-29T17:09:08.810158+0000","last_unstale":"2023-07-29T17:09:10.634153+0000","last_undegraded":"2023-07-29T17:09:10.634153+0000","last_fullsized":"2023-07-29T17:09:10.634153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:56.238740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:09.803084+0000","last_change":"2023-07-29T17:09:03.391071+0000","last_active":"2023-07-29T17:09:09.803084+0000","last_peered":"2023-07-29T17:09:09.803084+0000","last_clean":"2023-07-29T17:09:09.803084+0000","last_became_active":"2023-07-29T17:09:03.390770+0000","last_became_peered":"2023-07-29T17:09:03.390770+0000","last_unstale":"2023-07-29T17:09:09.803084+0000","last_undegraded":"2023-07-29T17:09:09.803084+0000","last_fullsized":"2023-07-29T17:09:09.803084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:02.374698+0000","last_clean_scrub_stamp":"2023-07-29T17:09:02.374698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:00:44.154632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:13.498235+0000","last_change":"2023-07-29T17:09:08.419024+0000","last_active":"2023-07-29T17:09:13.498235+0000","last_peered":"2023-07-29T17:09:13.498235+0000","last_clean":"2023-07-29T17:09:13.498235+0000","last_became_active":"2023-07-29T17:09:08.418693+0000","last_became_peered":"2023-07-29T17:09:08.418693+0000","last_unstale":"2023-07-29T17:09:13.498235+0000","last_undegraded":"2023-07-29T17:09:13.498235+0000","last_fullsized":"2023-07-29T17:09:13.498235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:01:22.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637073+0000","last_change":"2023-07-29T17:09:08.810977+0000","last_active":"2023-07-29T17:09:10.637073+0000","last_peered":"2023-07-29T17:09:10.637073+0000","last_clean":"2023-07-29T17:09:10.637073+0000","last_became_active":"2023-07-29T17:09:08.810187+0000","last_became_peered":"2023-07-29T17:09:08.810187+0000","last_unstale":"2023-07-29T17:09:10.637073+0000","last_undegraded":"2023-07-29T17:09:10.637073+0000","last_fullsized":"2023-07-29T17:09:10.637073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637195+0000","last_change":"2023-07-29T17:09:08.417529+0000","last_active":"2023-07-29T17:09:10.637195+0000","last_peered":"2023-07-29T17:09:10.637195+0000","last_clean":"2023-07-29T17:09:10.637195+0000","last_became_active":"2023-07-29T17:09:08.417063+0000","last_became_peered":"2023-07-29T17:09:08.417063+0000","last_unstale":"2023-07-29T17:09:10.637195+0000","last_undegraded":"2023-07-29T17:09:10.637195+0000","last_fullsized":"2023-07-29T17:09:10.637195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:42:25.228904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637251+0000","last_change":"2023-07-29T17:09:08.809823+0000","last_active":"2023-07-29T17:09:10.637251+0000","last_peered":"2023-07-29T17:09:10.637251+0000","last_clean":"2023-07-29T17:09:10.637251+0000","last_became_active":"2023-07-29T17:09:08.808914+0000","last_became_peered":"2023-07-29T17:09:08.808914+0000","last_unstale":"2023-07-29T17:09:10.637251+0000","last_undegraded":"2023-07-29T17:09:10.637251+0000","last_fullsized":"2023-07-29T17:09:10.637251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:48:32.391712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636472+0000","last_change":"2023-07-29T17:09:08.421290+0000","last_active":"2023-07-29T17:09:10.636472+0000","last_peered":"2023-07-29T17:09:10.636472+0000","last_clean":"2023-07-29T17:09:10.636472+0000","last_became_active":"2023-07-29T17:09:08.420873+0000","last_became_peered":"2023-07-29T17:09:08.420873+0000","last_unstale":"2023-07-29T17:09:10.636472+0000","last_undegraded":"2023-07-29T17:09:10.636472+0000","last_fullsized":"2023-07-29T17:09:10.636472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:11:53.008065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636405+0000","last_change":"2023-07-29T17:09:08.810661+0000","last_active":"2023-07-29T17:09:10.636405+0000","last_peered":"2023-07-29T17:09:10.636405+0000","last_clean":"2023-07-29T17:09:10.636405+0000","last_became_active":"2023-07-29T17:09:08.808931+0000","last_became_peered":"2023-07-29T17:09:08.808931+0000","last_unstale":"2023-07-29T17:09:10.636405+0000","last_undegraded":"2023-07-29T17:09:10.636405+0000","last_fullsized":"2023-07-29T17:09:10.636405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:28:40.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637301+0000","last_change":"2023-07-29T17:09:08.418432+0000","last_active":"2023-07-29T17:09:10.637301+0000","last_peered":"2023-07-29T17:09:10.637301+0000","last_clean":"2023-07-29T17:09:10.637301+0000","last_became_active":"2023-07-29T17:09:08.418112+0000","last_became_peered":"2023-07-29T17:09:08.418112+0000","last_unstale":"2023-07-29T17:09:10.637301+0000","last_undegraded":"2023-07-29T17:09:10.637301+0000","last_fullsized":"2023-07-29T17:09:10.637301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:41:17.711568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636355+0000","last_change":"2023-07-29T17:09:08.808816+0000","last_active":"2023-07-29T17:09:10.636355+0000","last_peered":"2023-07-29T17:09:10.636355+0000","last_clean":"2023-07-29T17:09:10.636355+0000","last_became_active":"2023-07-29T17:09:08.807762+0000","last_became_peered":"2023-07-29T17:09:08.807762+0000","last_unstale":"2023-07-29T17:09:10.636355+0000","last_undegraded":"2023-07-29T17:09:10.636355+0000","last_fullsized":"2023-07-29T17:09:10.636355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:22:00.485451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634385+0000","last_change":"2023-07-29T17:09:08.414617+0000","last_active":"2023-07-29T17:09:10.634385+0000","last_peered":"2023-07-29T17:09:10.634385+0000","last_clean":"2023-07-29T17:09:10.634385+0000","last_became_active":"2023-07-29T17:09:08.414331+0000","last_became_peered":"2023-07-29T17:09:08.414331+0000","last_unstale":"2023-07-29T17:09:10.634385+0000","last_undegraded":"2023-07-29T17:09:10.634385+0000","last_fullsized":"2023-07-29T17:09:10.634385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:16:50.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637120+0000","last_change":"2023-07-29T17:09:08.807602+0000","last_active":"2023-07-29T17:09:10.637120+0000","last_peered":"2023-07-29T17:09:10.637120+0000","last_clean":"2023-07-29T17:09:10.637120+0000","last_became_active":"2023-07-29T17:09:08.806923+0000","last_became_peered":"2023-07-29T17:09:08.806923+0000","last_unstale":"2023-07-29T17:09:10.637120+0000","last_undegraded":"2023-07-29T17:09:10.637120+0000","last_fullsized":"2023-07-29T17:09:10.637120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:48:41.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634446+0000","last_change":"2023-07-29T17:09:08.417357+0000","last_active":"2023-07-29T17:09:10.634446+0000","last_peered":"2023-07-29T17:09:10.634446+0000","last_clean":"2023-07-29T17:09:10.634446+0000","last_became_active":"2023-07-29T17:09:08.417151+0000","last_became_peered":"2023-07-29T17:09:08.417151+0000","last_unstale":"2023-07-29T17:09:10.634446+0000","last_undegraded":"2023-07-29T17:09:10.634446+0000","last_fullsized":"2023-07-29T17:09:10.634446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:07.398008+0000","last_clean_scrub_stamp":"2023-07-29T17:09:07.398008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:11.228131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636293+0000","last_change":"2023-07-29T17:09:08.809139+0000","last_active":"2023-07-29T17:09:10.636293+0000","last_peered":"2023-07-29T17:09:10.636293+0000","last_clean":"2023-07-29T17:09:10.636293+0000","last_became_active":"2023-07-29T17:09:08.808038+0000","last_became_peered":"2023-07-29T17:09:08.808038+0000","last_unstale":"2023-07-29T17:09:10.636293+0000","last_undegraded":"2023-07-29T17:09:10.636293+0000","last_fullsized":"2023-07-29T17:09:10.636293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:46:36.658721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.636271+0000","last_change":"2023-07-29T17:09:08.810070+0000","last_active":"2023-07-29T17:09:10.636271+0000","last_peered":"2023-07-29T17:09:10.636271+0000","last_clean":"2023-07-29T17:09:10.636271+0000","last_became_active":"2023-07-29T17:09:08.809066+0000","last_became_peered":"2023-07-29T17:09:08.809066+0000","last_unstale":"2023-07-29T17:09:10.636271+0000","last_undegraded":"2023-07-29T17:09:10.636271+0000","last_fullsized":"2023-07-29T17:09:10.636271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634215+0000","last_change":"2023-07-29T17:09:08.804466+0000","last_active":"2023-07-29T17:09:10.634215+0000","last_peered":"2023-07-29T17:09:10.634215+0000","last_clean":"2023-07-29T17:09:10.634215+0000","last_became_active":"2023-07-29T17:09:08.804029+0000","last_became_peered":"2023-07-29T17:09:08.804029+0000","last_unstale":"2023-07-29T17:09:10.634215+0000","last_undegraded":"2023-07-29T17:09:10.634215+0000","last_fullsized":"2023-07-29T17:09:10.634215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:42:48.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637175+0000","last_change":"2023-07-29T17:09:08.810490+0000","last_active":"2023-07-29T17:09:10.637175+0000","last_peered":"2023-07-29T17:09:10.637175+0000","last_clean":"2023-07-29T17:09:10.637175+0000","last_became_active":"2023-07-29T17:09:08.809221+0000","last_became_peered":"2023-07-29T17:09:08.809221+0000","last_unstale":"2023-07-29T17:09:10.637175+0000","last_undegraded":"2023-07-29T17:09:10.637175+0000","last_fullsized":"2023-07-29T17:09:10.637175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:00:33.409767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.634307+0000","last_change":"2023-07-29T17:09:08.804976+0000","last_active":"2023-07-29T17:09:10.634307+0000","last_peered":"2023-07-29T17:09:10.634307+0000","last_clean":"2023-07-29T17:09:10.634307+0000","last_became_active":"2023-07-29T17:09:08.804423+0000","last_became_peered":"2023-07-29T17:09:08.804423+0000","last_unstale":"2023-07-29T17:09:10.634307+0000","last_undegraded":"2023-07-29T17:09:10.634307+0000","last_fullsized":"2023-07-29T17:09:10.634307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:06:20.829461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-07-29T17:09:10.637262+0000","last_change":"2023-07-29T17:09:08.811051+0000","last_active":"2023-07-29T17:09:10.637262+0000","last_peered":"2023-07-29T17:09:10.637262+0000","last_clean":"2023-07-29T17:09:10.637262+0000","last_became_active":"2023-07-29T17:09:08.810621+0000","last_became_peered":"2023-07-29T17:09:08.810621+0000","last_unstale":"2023-07-29T17:09:10.637262+0000","last_undegraded":"2023-07-29T17:09:10.637262+0000","last_fullsized":"2023-07-29T17:09:10.637262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T17:09:08.403086+0000","last_clean_scrub_stamp":"2023-07-29T17:09:08.403086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:09.298099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19916,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":654023,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":654639,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9958,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T17:09:34.877 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [1, 0] 2023-07-29T17:09:34.877 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.2', '1', '0'] 2023-07-29T17:09:34.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.2 1 0 2023-07-29T17:09:34.881 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:34.868+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:34.935 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:34.945 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:34.981 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:34.969+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:35.082 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:35.070+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:35.092 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:35.092 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:35.092 INFO:teuthology.orchestra.run.smithi093.stdout: "num_ops": 0 2023-07-29T17:09:35.092 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:35.102 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:35.183 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:35.171+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:35.230 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:35.231 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:35.231 INFO:teuthology.orchestra.run.smithi093.stdout: "complaint_time": 30, 2023-07-29T17:09:35.231 INFO:teuthology.orchestra.run.smithi093.stdout: "num_blocked_ops": 0 2023-07-29T17:09:35.231 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:35.240 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:35.241 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:35.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:35.283 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:35.270+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:35.370 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:35.370 INFO:teuthology.orchestra.run.smithi093.stdout: "size": 20, 2023-07-29T17:09:35.370 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 600, 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [ 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.774575356, 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012704160000000001, 2023-07-29T17:09:35.371 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 116 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.372 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.373 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:35.374 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.374 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.374 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.375 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580935+0000", 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.649e-06 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580939+0000", 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.658e-06 2023-07-29T17:09:35.376 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580942+0000", 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7199999999999998e-06 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.377 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588048+0000", 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.007105971 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588097+0000", 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9279e-05 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.378 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588183+0000", 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6169999999999997e-05 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.379 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589060+0000", 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00087682500000000002 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593496+0000", 2023-07-29T17:09:35.380 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0044364740000000001 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593579+0000", 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2255000000000004e-05 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.381 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593637+0000", 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.8615e-05 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.382 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.383 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.383 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.383 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:35.383 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.774564021000003, 2023-07-29T17:09:35.383 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012802693, 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.384 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 117 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:35.385 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.386 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.386 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.386 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.386 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:35.387 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.387 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.387 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.387 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.388 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:35.388 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:35.388 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.388 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580947+0000", 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.389 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.390 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580952+0000", 2023-07-29T17:09:35.390 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.0209999999999999e-06 2023-07-29T17:09:35.390 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.390 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.390 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580955+0000", 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7750000000000001e-06 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.391 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588443+0000", 2023-07-29T17:09:35.392 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0074877240000000003 2023-07-29T17:09:35.392 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.392 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.392 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.392 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588533+0000", 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.0561000000000002e-05 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588628+0000", 2023-07-29T17:09:35.393 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.4355e-05 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589944+0000", 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001316401 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.394 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593693+0000", 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0037494529999999998 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593726+0000", 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2359e-05 2023-07-29T17:09:35.395 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593747+0000", 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.1364000000000001e-05 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.396 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.672942167999999, 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010198067999999999, 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.397 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 137 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.398 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.399 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.400 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682611+0000", 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5226999999999999e-05 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.401 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682617+0000", 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9599999999999997e-06 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682623+0000", 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4210000000000003e-06 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.402 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686489+0000", 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038660999999999999 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686535+0000", 2023-07-29T17:09:35.403 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6050999999999997e-05 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686606+0000", 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.1687000000000007e-05 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.404 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688623+0000", 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0020160569999999999 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.405 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692722+0000", 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0040992190000000003 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692744+0000", 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2586e-05 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.406 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692764+0000", 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0035e-05 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.407 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.672882196000003, 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010220088, 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.408 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 138 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.409 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.410 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.411 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682628+0000", 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0959999999999999e-06 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682632+0000", 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0280000000000002e-06 2023-07-29T17:09:35.412 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682636+0000", 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.613e-06 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686959+0000", 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043234190000000002 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687005+0000", 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5695000000000002e-05 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.414 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687082+0000", 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.6922000000000007e-05 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688629+0000", 2023-07-29T17:09:35.415 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0015476050000000001 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692797+0000", 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0041680859999999997 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.416 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692825+0000", 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7928000000000001e-05 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692846+0000", 2023-07-29T17:09:35.417 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0985e-05 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.418 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:35.419 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.672869939999998, 2023-07-29T17:09:35.419 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010277467, 2023-07-29T17:09:35.419 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.419 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 139 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.420 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:35.421 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682638+0000", 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.422 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682641+0000", 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6460000000000002e-06 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682645+0000", 2023-07-29T17:09:35.423 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9840000000000003e-06 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682648+0000", 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6060000000000001e-06 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.424 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687316+0000", 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0046686189999999997 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687368+0000", 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2145999999999998e-05 2023-07-29T17:09:35.425 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687439+0000", 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0261999999999999e-05 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.426 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688635+0000", 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0011961859999999999 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692867+0000", 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0042322319999999998 2023-07-29T17:09:35.427 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692895+0000", 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.8416999999999999e-05 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.428 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692916+0000", 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0602999999999999e-05 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.429 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.672854086999997, 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010365035999999999, 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.430 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 140 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.431 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.432 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682700+0000", 2023-07-29T17:09:35.433 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6201e-05 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682705+0000", 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3669999999999999e-06 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.434 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682708+0000", 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687669+0000", 2023-07-29T17:09:35.435 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0049609889999999999 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687717+0000", 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.8364e-05 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.436 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687791+0000", 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3783999999999997e-05 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688641+0000", 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00085023200000000003 2023-07-29T17:09:35.437 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692974+0000", 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043330160000000003 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.438 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693000+0000", 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6179000000000001e-05 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693019+0000", 2023-07-29T17:09:35.439 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.9326000000000001e-05 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:35.440 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 36.672797627999998, 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010373451000000001, 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:35.441 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 141 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.442 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.443 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682714+0000", 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6260000000000001e-06 2023-07-29T17:09:35.444 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682717+0000", 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2490000000000001e-06 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.445 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682720+0000", 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5019999999999999e-06 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688243+0000", 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055235320000000003 2023-07-29T17:09:35.446 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688298+0000", 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4863e-05 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.447 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688378+0000", 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9877999999999997e-05 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.689466+0000", 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0010876250000000001 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.448 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693041+0000", 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0035748099999999999 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.449 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693066+0000", 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5592000000000002e-05 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693084+0000", 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8051999999999999e-05 2023-07-29T17:09:35.450 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:35.451 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.557315782, 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01054736, 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.452 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.453 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798191+0000", 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.454 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798200+0000", 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.3890000000000005e-06 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798441+0000", 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00024168400000000001 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.455 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798460+0000", 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8791e-05 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800079+0000", 2023-07-29T17:09:35.456 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001618436 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800239+0000", 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000160051 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.457 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800394+0000", 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000155847 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.458 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.807144+0000", 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067495480000000002 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808238+0000", 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001094308 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.459 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808284+0000", 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5327000000000002e-05 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808740+0000", 2023-07-29T17:09:35.460 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000456398 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:35.461 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.556412990999998, 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012771879999999999, 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.462 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.463 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799095+0000", 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799101+0000", 2023-07-29T17:09:35.464 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6510000000000004e-06 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799115+0000", 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.3427e-05 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.465 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799123+0000", 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2199999999999992e-06 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804445+0000", 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053221850000000001 2023-07-29T17:09:35.466 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804551+0000", 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000106205 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.467 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804694+0000", 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0001428 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811719+0000", 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0070253709999999999 2023-07-29T17:09:35.468 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811784+0000", 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.4465e-05 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.469 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811827+0000", 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3235000000000002e-05 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811867+0000", 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0238999999999999e-05 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.470 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.556375321000001, 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.014863889, 2023-07-29T17:09:35.471 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.472 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:35.473 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799137+0000", 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.474 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799147+0000", 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.9599999999999995e-06 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:35.475 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4793999999999997e-05 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805488+0000", 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0062865489999999998 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.476 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806468+0000", 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00097922599999999992 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806765+0000", 2023-07-29T17:09:35.477 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00029750499999999999 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813753+0000", 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0069874689999999996 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.478 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813893+0000", 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000140226 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813938+0000", 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.4642999999999999e-05 2023-07-29T17:09:35.479 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813997+0000", 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9506999999999998e-05 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.480 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.556269122, 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015133384999999999, 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.481 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.482 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:35.483 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.483 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.483 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.483 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.484 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799238+0000", 2023-07-29T17:09:35.484 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:35.484 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.484 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.485 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.485 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799246+0000", 2023-07-29T17:09:35.485 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3470000000000001e-06 2023-07-29T17:09:35.485 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.485 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799257+0000", 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1331999999999999e-05 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.486 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799266+0000", 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.7180000000000002e-06 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810513+0000", 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011246920000000001 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810627+0000", 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000114282 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.488 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811304+0000", 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067641100000000003 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814140+0000", 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.002836281 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.489 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814300+0000", 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00016066 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.490 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814336+0000", 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5805e-05 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814373+0000", 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6508999999999999e-05 2023-07-29T17:09:35.491 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.492 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.492 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.492 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.492 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.492 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555925942000002, 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015275607, 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.493 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:35.494 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799582+0000", 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.495 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.496 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799588+0000", 2023-07-29T17:09:35.496 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6590000000000004e-06 2023-07-29T17:09:35.496 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.496 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.496 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.497 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799597+0000", 2023-07-29T17:09:35.497 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.6649999999999998e-06 2023-07-29T17:09:35.497 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.497 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.497 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799605+0000", 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1170000000000004e-06 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812036+0000", 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430636 2023-07-29T17:09:35.498 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812463+0000", 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00042748299999999999 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.499 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812602+0000", 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00013831499999999999 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001908893 2023-07-29T17:09:35.500 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814800+0000", 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00028917999999999999 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.501 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.502 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814836+0000", 2023-07-29T17:09:35.502 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5948999999999998e-05 2023-07-29T17:09:35.502 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.502 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.502 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814858+0000", 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2390000000000001e-05 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.503 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:16 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555865570000002, 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010747720000000001, 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.504 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.505 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799642+0000", 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.506 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799646+0000", 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9620000000000004e-06 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.507 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799654+0000", 2023-07-29T17:09:35.508 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.199e-06 2023-07-29T17:09:35.508 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.508 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.508 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.508 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799661+0000", 2023-07-29T17:09:35.509 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.9530000000000002e-06 2023-07-29T17:09:35.509 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.509 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.509 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.509 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800044+0000", 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000383046 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800233+0000", 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018905699999999999 2023-07-29T17:09:35.510 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800418+0000", 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018494099999999999 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.511 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806466+0000", 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0060481170000000004 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810286+0000", 2023-07-29T17:09:35.512 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038198450000000001 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810348+0000", 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2062000000000003e-05 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.513 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810391+0000", 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3031000000000002e-05 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.514 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.515 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:35.515 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555659063, 2023-07-29T17:09:35.515 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015461856, 2023-07-29T17:09:35.515 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.516 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:35.517 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799855+0000", 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8020000000000003e-06 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.518 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799865+0000", 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.628e-06 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.519 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799873+0000", 2023-07-29T17:09:35.520 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1480000000000006e-06 2023-07-29T17:09:35.520 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.520 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.520 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.521 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812921+0000", 2023-07-29T17:09:35.521 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013048110999999999 2023-07-29T17:09:35.521 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813008+0000", 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6581000000000003e-05 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.522 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813143+0000", 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000135258 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814890+0000", 2023-07-29T17:09:35.523 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001747293 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815225+0000", 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000334648 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.524 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815268+0000", 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815311+0000", 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3349000000000001e-05 2023-07-29T17:09:35.525 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.526 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.526 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.526 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.526 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.526 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555532939999999, 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010570684, 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.527 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.528 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:35.528 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.528 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.528 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799975+0000", 2023-07-29T17:09:35.529 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799979+0000", 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.7419999999999999e-06 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.530 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799986+0000", 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2710000000000003e-06 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.531 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799993+0000", 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2150000000000004e-06 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802486+0000", 2023-07-29T17:09:35.532 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0024926330000000002 2023-07-29T17:09:35.533 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.533 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.533 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.533 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802589+0000", 2023-07-29T17:09:35.533 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000103041 2023-07-29T17:09:35.534 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.534 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.534 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:35.534 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802782+0000", 2023-07-29T17:09:35.534 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00019310599999999999 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808103+0000", 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053207870000000004 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.535 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810437+0000", 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0023346930000000001 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.536 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810480+0000", 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810546+0000", 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6005000000000002e-05 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.537 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555501777, 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011747502, 2023-07-29T17:09:35.538 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.539 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.540 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.541 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800006+0000", 2023-07-29T17:09:35.541 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.541 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.541 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.541 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800017+0000", 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1147e-05 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800025+0000", 2023-07-29T17:09:35.542 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.8329999999999994e-06 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800033+0000", 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9100000000000005e-06 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.543 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800215+0000", 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018224800000000001 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.544 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800360+0000", 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000144676 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800811+0000", 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000451457 2023-07-29T17:09:35.545 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.546 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.546 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.546 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:35.546 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055944840000000003 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811663+0000", 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052574379999999997 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.547 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811713+0000", 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9375000000000001e-05 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.548 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811754+0000", 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1445e-05 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.549 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555461871999999, 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01314661, 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.550 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:35.551 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800046+0000", 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.552 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800051+0000", 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5979999999999999e-06 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.553 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800060+0000", 2023-07-29T17:09:35.554 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.482e-06 2023-07-29T17:09:35.554 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.554 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.554 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.554 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800067+0000", 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0430000000000002e-06 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802741+0000", 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0026741289999999999 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.555 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802884+0000", 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014245699999999999 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.556 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.803031+0000", 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014711699999999999 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808271+0000", 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052402430000000003 2023-07-29T17:09:35.557 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813100+0000", 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0048288360000000004 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.558 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.559 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.559 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813152+0000", 2023-07-29T17:09:35.559 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.1560000000000001e-05 2023-07-29T17:09:35.559 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813193+0000", 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1690000000000002e-05 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.560 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555370099000001, 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013580643, 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.561 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.562 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:35.563 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800148+0000", 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.0010000000000001e-05 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.564 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.565 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800154+0000", 2023-07-29T17:09:35.565 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.1680000000000001e-06 2023-07-29T17:09:35.565 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.565 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.565 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800158+0000", 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1110000000000001e-06 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804064+0000", 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0039061370000000001 2023-07-29T17:09:35.566 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804183+0000", 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00011890100000000001 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.567 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804326+0000", 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014277300000000001 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811446+0000", 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0071207800000000002 2023-07-29T17:09:35.568 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813290+0000", 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0018438899999999999 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.569 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813347+0000", 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6555999999999999e-05 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813719+0000", 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000372142 2023-07-29T17:09:35.570 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.571 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.571 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.571 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.571 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.572 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.572 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:35.572 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555326959999999, 2023-07-29T17:09:35.572 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430045000000001, 2023-07-29T17:09:35.573 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.573 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:35.573 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.574 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.574 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.574 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:35.574 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.575 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.575 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.575 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.575 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:35.576 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.576 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.576 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.576 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.577 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800181+0000", 2023-07-29T17:09:35.577 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:35.577 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.578 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.578 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.578 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800185+0000", 2023-07-29T17:09:35.578 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1659999999999996e-06 2023-07-29T17:09:35.579 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.579 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.579 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.579 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800192+0000", 2023-07-29T17:09:35.580 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2339999999999997e-06 2023-07-29T17:09:35.580 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.580 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.580 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.581 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800199+0000", 2023-07-29T17:09:35.581 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.7950000000000002e-06 2023-07-29T17:09:35.581 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.581 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.582 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.582 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801571+0000", 2023-07-29T17:09:35.582 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001372201 2023-07-29T17:09:35.582 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.583 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.583 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.583 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801715+0000", 2023-07-29T17:09:35.583 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014396499999999999 2023-07-29T17:09:35.584 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.584 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.584 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:35.584 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802391+0000", 2023-07-29T17:09:35.585 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067586000000000002 2023-07-29T17:09:35.585 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.585 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.585 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:35.586 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.809114+0000", 2023-07-29T17:09:35.586 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067226910000000003 2023-07-29T17:09:35.586 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.586 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.587 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:35.587 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812051+0000", 2023-07-29T17:09:35.587 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0029367920000000001 2023-07-29T17:09:35.587 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.588 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.588 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:35.588 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812103+0000", 2023-07-29T17:09:35.588 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2806000000000002e-05 2023-07-29T17:09:35.589 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.589 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.589 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.589 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812612+0000", 2023-07-29T17:09:35.590 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00050817099999999997 2023-07-29T17:09:35.590 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.590 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.590 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.591 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.591 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.591 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:35.591 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:35.592 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 26.555247794, 2023-07-29T17:09:35.592 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013634713999999999, 2023-07-29T17:09:35.592 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:35.592 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "started", 2023-07-29T17:09:35.593 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:35.593 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.593 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:35.594 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:35.594 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.594 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.594 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.595 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:35.595 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:35.595 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:35.595 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.596 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.596 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:35.596 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800260+0000", 2023-07-29T17:09:35.596 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:35.597 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.597 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.597 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:35.597 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800264+0000", 2023-07-29T17:09:35.598 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6040000000000001e-06 2023-07-29T17:09:35.598 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.598 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.598 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800270+0000", 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2820000000000002e-06 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:35.599 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800277+0000", 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8800000000000002e-06 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805286+0000", 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0050090320000000001 2023-07-29T17:09:35.600 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805474+0000", 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018839799999999999 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:35.601 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813895+0000", 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0084212560000000002 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:35.602 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:35.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T17:09:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:set 3.2 pg_upmap mapping to [1,0] 2023-07-29T17:09:35.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:35.607 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:35.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T17:09:35.608 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:35.591+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:35.704 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:35.692+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:35.746 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:35.747 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:35.747 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:35.747 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:35.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:35.805 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:35.792+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:35.884 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:35.884 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:35.884 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:35.884 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:35.884 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:35.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:35.936 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:35.923+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:35.974 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-07-29T17:09:35.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T17:09:36.007 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:35.993+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:36.023 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.538479344999999, 2023-07-29T17:09:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.324093529999999, 2023-07-29T17:09:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.322538010000002, 2023-07-29T17:09:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.322045725999999, 2023-07-29T17:09:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.321688895000001, 2023-07-29T17:09:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.321254381999999, 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.210911268, 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.210458365000001, 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.210028340000001, 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:36.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:36.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:36.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:36.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.209983561000001, 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.136 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:36.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.145 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.20995641, 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:36.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:36.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.154 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.209931835999999, 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:36.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:36.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:36.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:36.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.209918332000001, 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:36.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:36.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:36.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:36.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:36.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.209898261999999, 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:36.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:36.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:36.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.209684287999998, 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:36.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:36.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.203286697999999, 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:36.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:36.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:36.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.202905006000002, 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:36.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:36.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:36.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.202882306999999, 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.203 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:36.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:36.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:36.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:36.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.202620006, 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:36.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:36.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:36.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.202520679999999, 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:36.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:36.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:36.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:36.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:36.225 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:36.226 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:36.214+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:36.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:36.304 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-07-29T17:09:36.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-29T17:09:36.327 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:36.314+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:36.371 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:36.371 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2023-07-29T17:09:36.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:36.428 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:36.415+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:36.510 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:36.511 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:36.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:36.563 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:36.551+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:36.630 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:36.617+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:36.647 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:36.647 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:36.657 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-07-29T17:09:36.674 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:09:36.675 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T17:09:36.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:09:36.730 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:36.718+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:36.804 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:36.804 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:36.805 INFO:teuthology.orchestra.run.smithi093.stdout: "num_ops": 0 2023-07-29T17:09:36.805 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:36.815 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:36.831 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:36.818+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:36.931 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:36.918+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:36.943 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:36.943 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [], 2023-07-29T17:09:36.943 INFO:teuthology.orchestra.run.smithi093.stdout: "complaint_time": 30, 2023-07-29T17:09:36.943 INFO:teuthology.orchestra.run.smithi093.stdout: "num_blocked_ops": 0 2023-07-29T17:09:36.943 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:36.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:37.032 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:37.019+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:37.049 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:09:37.049 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:36.354623+0000","last_up_change":"2023-07-29T17:08:55.071812+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists","up"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:09:37.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T17:08:56.668318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T17:09:01.905239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T17:09:06.456697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T17:09:07.770105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T17:09:37.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T17:09:37.082 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-07-29T17:09:37.082 INFO:teuthology.orchestra.run.smithi093.stdout: "size": 20, 2023-07-29T17:09:37.082 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 600, 2023-07-29T17:09:37.082 INFO:teuthology.orchestra.run.smithi093.stdout: "ops": [ 2023-07-29T17:09:37.083 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.083 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.083 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:37.083 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.487508429000002, 2023-07-29T17:09:37.083 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012704160000000001, 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 116 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.084 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.085 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580933+0000", 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.086 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580935+0000", 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.649e-06 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.087 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580939+0000", 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.658e-06 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580942+0000", 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7199999999999998e-06 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.088 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588048+0000", 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.007105971 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588097+0000", 2023-07-29T17:09:37.089 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9279e-05 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588183+0000", 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6169999999999997e-05 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.090 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589060+0000", 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00087682500000000002 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593496+0000", 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0044364740000000001 2023-07-29T17:09:37.091 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593579+0000", 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2255000000000004e-05 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.092 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593637+0000", 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.8615e-05 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.093 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.487497093999998, 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012802693, 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.094 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 117 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.095 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.096 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580944+0000", 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580947+0000", 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.097 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580952+0000", 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.0209999999999999e-06 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.580955+0000", 2023-07-29T17:09:37.098 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7750000000000001e-06 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588443+0000", 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0074877240000000003 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.099 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588533+0000", 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.0561000000000002e-05 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.588628+0000", 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.4355e-05 2023-07-29T17:09:37.100 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.589944+0000", 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001316401 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.101 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593693+0000", 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0037494529999999998 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593726+0000", 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2359e-05 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.102 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.593747+0000", 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.1364000000000001e-05 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.103 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.385875241000001, 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010198067999999999, 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.104 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 137 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.105 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.106 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.107 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.107 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682566+0000", 2023-07-29T17:09:37.107 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.107 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.107 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682611+0000", 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5226999999999999e-05 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682617+0000", 2023-07-29T17:09:37.108 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9599999999999997e-06 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682623+0000", 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4210000000000003e-06 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.109 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686489+0000", 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038660999999999999 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686535+0000", 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6050999999999997e-05 2023-07-29T17:09:37.110 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686606+0000", 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.1687000000000007e-05 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.111 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688623+0000", 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0020160569999999999 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692722+0000", 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0040992190000000003 2023-07-29T17:09:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692744+0000", 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2586e-05 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.113 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692764+0000", 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0035e-05 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.114 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.385815268999998, 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010220088, 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.115 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 138 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.116 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.117 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682626+0000", 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682628+0000", 2023-07-29T17:09:37.118 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0959999999999999e-06 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682632+0000", 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0280000000000002e-06 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.119 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682636+0000", 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.613e-06 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.686959+0000", 2023-07-29T17:09:37.120 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043234190000000002 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687005+0000", 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5695000000000002e-05 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.121 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687082+0000", 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.6922000000000007e-05 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688629+0000", 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0015476050000000001 2023-07-29T17:09:37.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692797+0000", 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0041680859999999997 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.123 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692825+0000", 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.7928000000000001e-05 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692846+0000", 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0985e-05 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.124 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.385803013, 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010277467, 2023-07-29T17:09:37.125 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 139 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.126 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682639+0000", 2023-07-29T17:09:37.127 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682638+0000", 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967296 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.128 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682641+0000", 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6460000000000002e-06 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682645+0000", 2023-07-29T17:09:37.129 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9840000000000003e-06 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682648+0000", 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6060000000000001e-06 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.130 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687316+0000", 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0046686189999999997 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687368+0000", 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2145999999999998e-05 2023-07-29T17:09:37.131 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687439+0000", 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0261999999999999e-05 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688635+0000", 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0011961859999999999 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692867+0000", 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0042322319999999998 2023-07-29T17:09:37.133 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692895+0000", 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.8416999999999999e-05 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.134 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692916+0000", 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.0602999999999999e-05 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.135 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.38578716, 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010365035999999999, 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.136 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 140 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.137 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682654+0000", 2023-07-29T17:09:37.138 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682700+0000", 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6201e-05 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.139 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682705+0000", 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3669999999999999e-06 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682708+0000", 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.9079999999999999e-06 2023-07-29T17:09:37.140 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687669+0000", 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0049609889999999999 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.141 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687717+0000", 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.8364e-05 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.687791+0000", 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3783999999999997e-05 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.142 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688641+0000", 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00085023200000000003 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.692974+0000", 2023-07-29T17:09:37.143 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0043330160000000003 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693000+0000", 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.6179000000000001e-05 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.144 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693019+0000", 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.9326000000000001e-05 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.145 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(client.4179.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 38.385730701, 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010373451000000001, 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "client_info": { 2023-07-29T17:09:37.146 INFO:teuthology.orchestra.run.smithi093.stdout: "client": "client.4179", 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "client_addr": "172.21.15.73:0/738089787", 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "tid": 141 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:37.147 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.148 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682711+0000", 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682714+0000", 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6260000000000001e-06 2023-07-29T17:09:37.149 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682717+0000", 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.2490000000000001e-06 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.150 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.682720+0000", 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5019999999999999e-06 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688243+0000", 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055235320000000003 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.151 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688298+0000", 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4863e-05 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.688378+0000", 2023-07-29T17:09:37.152 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9877999999999997e-05 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.689466+0000", 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0010876250000000001 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.153 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693041+0000", 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0035748099999999999 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693066+0000", 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.5592000000000002e-05 2023-07-29T17:09:37.154 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:08:58.693084+0000", 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8051999999999999e-05 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.155 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.270248854999998, 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01054736, 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.156 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.157 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798193+0000", 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798191+0000", 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:37.158 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798200+0000", 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.3890000000000005e-06 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.159 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798441+0000", 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00024168400000000001 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.798460+0000", 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.8791e-05 2023-07-29T17:09:37.160 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800079+0000", 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001618436 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.161 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800239+0000", 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000160051 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800394+0000", 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000155847 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.162 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.807144+0000", 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067495480000000002 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808238+0000", 2023-07-29T17:09:37.163 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001094308 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808284+0000", 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5327000000000002e-05 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.164 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808740+0000", 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000456398 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.165 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.269346064, 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012771879999999999, 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.166 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799096+0000", 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.167 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799095+0000", 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.168 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799101+0000", 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6510000000000004e-06 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799115+0000", 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.3427e-05 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.169 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799123+0000", 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.2199999999999992e-06 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804445+0000", 2023-07-29T17:09:37.170 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053221850000000001 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804551+0000", 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000106205 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.171 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804694+0000", 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0001428 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811719+0000", 2023-07-29T17:09:37.172 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0070253709999999999 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811784+0000", 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.4465e-05 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.173 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811827+0000", 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3235000000000002e-05 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811867+0000", 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.0238999999999999e-05 2023-07-29T17:09:37.174 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.269308393999999, 2023-07-29T17:09:37.175 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.014863889, 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.176 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.177 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799133+0000", 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799137+0000", 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.178 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799147+0000", 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.9599999999999995e-06 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:37.179 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.4793999999999997e-05 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805488+0000", 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0062865489999999998 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.180 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806468+0000", 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00097922599999999992 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806765+0000", 2023-07-29T17:09:37.181 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00029750499999999999 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813753+0000", 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0069874689999999996 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.182 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813893+0000", 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000140226 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813938+0000", 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.4642999999999999e-05 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.183 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813997+0000", 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.9506999999999998e-05 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.269202194999998, 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015133384999999999, 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.185 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.186 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799239+0000", 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799238+0000", 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.187 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799246+0000", 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.3470000000000001e-06 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799257+0000", 2023-07-29T17:09:37.188 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1331999999999999e-05 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799266+0000", 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.7180000000000002e-06 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.189 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810513+0000", 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011246920000000001 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810627+0000", 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000114282 2023-07-29T17:09:37.190 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811304+0000", 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067641100000000003 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.191 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814140+0000", 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.002836281 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814300+0000", 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00016066 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.192 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814336+0000", 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5805e-05 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814373+0000", 2023-07-29T17:09:37.193 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6508999999999999e-05 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:37.194 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268859015, 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015275607, 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:37.195 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799583+0000", 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.196 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799582+0000", 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799588+0000", 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6590000000000004e-06 2023-07-29T17:09:37.197 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799597+0000", 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.6649999999999998e-06 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.198 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799605+0000", 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1170000000000004e-06 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812036+0000", 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430636 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.199 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812463+0000", 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00042748299999999999 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.200 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812602+0000", 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00013831499999999999 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001908893 2023-07-29T17:09:37.201 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814800+0000", 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00028917999999999999 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.202 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814836+0000", 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.5948999999999998e-05 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814858+0000", 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 2.2390000000000001e-05 2023-07-29T17:09:37.203 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:16 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:37.204 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268798643, 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010747720000000001, 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:37.205 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799643+0000", 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.206 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799642+0000", 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799646+0000", 2023-07-29T17:09:37.207 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.9620000000000004e-06 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799654+0000", 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.199e-06 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.208 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799661+0000", 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.9530000000000002e-06 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800044+0000", 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000383046 2023-07-29T17:09:37.209 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800233+0000", 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018905699999999999 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:37.210 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800418+0000", 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018494099999999999 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806466+0000", 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0060481170000000004 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.211 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810286+0000", 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0038198450000000001 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.212 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810348+0000", 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2062000000000003e-05 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810391+0000", 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3031000000000002e-05 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.213 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268592135999999, 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.015461856, 2023-07-29T17:09:37.214 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.215 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799849+0000", 2023-07-29T17:09:37.216 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799855+0000", 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8020000000000003e-06 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.217 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799865+0000", 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.628e-06 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799873+0000", 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.1480000000000006e-06 2023-07-29T17:09:37.218 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812921+0000", 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013048110999999999 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.219 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813008+0000", 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 8.6581000000000003e-05 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813143+0000", 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000135258 2023-07-29T17:09:37.220 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.814890+0000", 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001747293 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.221 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815225+0000", 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000334648 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815268+0000", 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.222 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.815311+0000", 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.3349000000000001e-05 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.223 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268466013000001, 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.010570684, 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.224 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:37.225 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799975+0000", 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.226 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799979+0000", 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.7419999999999999e-06 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799986+0000", 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2710000000000003e-06 2023-07-29T17:09:37.227 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.799993+0000", 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2150000000000004e-06 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.228 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802486+0000", 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0024926330000000002 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802589+0000", 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000103041 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.229 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802782+0000", 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00019310599999999999 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808103+0000", 2023-07-29T17:09:37.230 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0053207870000000004 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810437+0000", 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0023346930000000001 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.231 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810480+0000", 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.2840999999999999e-05 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.810546+0000", 2023-07-29T17:09:37.232 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.6005000000000002e-05 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:37.233 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268434849999998, 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.011747502, 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:37.234 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800007+0000", 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.235 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800006+0000", 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800017+0000", 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.1147e-05 2023-07-29T17:09:37.236 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800025+0000", 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.8329999999999994e-06 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.237 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800033+0000", 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.9100000000000005e-06 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800215+0000", 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018224800000000001 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.238 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800360+0000", 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000144676 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800811+0000", 2023-07-29T17:09:37.239 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000451457 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0055944840000000003 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.240 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811663+0000", 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052574379999999997 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811713+0000", 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.9375000000000001e-05 2023-07-29T17:09:37.241 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811754+0000", 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1445e-05 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.242 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268394945000001, 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.01314661, 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.243 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.244 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800047+0000", 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800046+0000", 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.245 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800051+0000", 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.5979999999999999e-06 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800060+0000", 2023-07-29T17:09:37.246 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 9.482e-06 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800067+0000", 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.0430000000000002e-06 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.247 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802741+0000", 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0026741289999999999 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802884+0000", 2023-07-29T17:09:37.248 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014245699999999999 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.803031+0000", 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014711699999999999 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.249 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.808271+0000", 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0052402430000000003 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813100+0000", 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0048288360000000004 2023-07-29T17:09:37.250 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813152+0000", 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.1560000000000001e-05 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813193+0000", 2023-07-29T17:09:37.251 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1690000000000002e-05 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.252 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268303172, 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013580643, 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.253 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.254 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800138+0000", 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800148+0000", 2023-07-29T17:09:37.255 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 1.0010000000000001e-05 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800154+0000", 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.1680000000000001e-06 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.256 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800158+0000", 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1110000000000001e-06 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804064+0000", 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0039061370000000001 2023-07-29T17:09:37.257 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804183+0000", 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00011890100000000001 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:37.258 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.804326+0000", 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014277300000000001 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.811446+0000", 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0071207800000000002 2023-07-29T17:09:37.259 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813290+0000", 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0018438899999999999 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.260 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813347+0000", 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.6555999999999999e-05 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813719+0000", 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.000372142 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.261 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268260033000001, 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.012430045000000001, 2023-07-29T17:09:37.262 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.263 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800182+0000", 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.264 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800181+0000", 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800185+0000", 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4.1659999999999996e-06 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.265 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800192+0000", 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 7.2339999999999997e-06 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800199+0000", 2023-07-29T17:09:37.266 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.7950000000000002e-06 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801571+0000", 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.001372201 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.267 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.801715+0000", 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00014396499999999999 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "waiting for subops from 0", 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.802391+0000", 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00067586000000000002 2023-07-29T17:09:37.268 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "op_commit", 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.809114+0000", 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0067226910000000003 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.269 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812051+0000", 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0029367920000000001 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "commit_sent", 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812103+0000", 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 5.2806000000000002e-05 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.270 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.812612+0000", 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00050817099999999997 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.271 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "initiated_at": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "age": 28.268180867000002, 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.013634713999999999, 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "type_data": { 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "flag_point": "started", 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: "events": [ 2023-07-29T17:09:37.272 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "initiated", 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "throttled", 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800261+0000", 2023-07-29T17:09:37.273 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "header_read", 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800260+0000", 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.274 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "all_read", 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800264+0000", 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 3.6040000000000001e-06 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "dispatched", 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800270+0000", 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.2820000000000002e-06 2023-07-29T17:09:37.275 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.800277+0000", 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 6.8800000000000002e-06 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "reached_pg", 2023-07-29T17:09:37.276 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805286+0000", 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0050090320000000001 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "started", 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.805474+0000", 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.00018839799999999999 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-07-29T17:09:37.277 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: "event": "done", 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: "time": "2023-07-29T17:09:08.813895+0000", 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: "duration": 0.0084212560000000002 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-07-29T17:09:37.278 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-07-29T17:09:37.279 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-07-29T17:09:37.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:37.281 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:37.267+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:37.356 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2023-07-29T17:09:37.381 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:37.369+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:37.382 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-07-29T17:09:37.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T17:09:37.421 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:37.421 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:37.421 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:37.421 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:37.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:37.482 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:37.469+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:37.560 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:37.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:37.561 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:37.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:37.583 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:37.570+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:37.683 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:37.671+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:37.712 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2023-07-29T17:09:37.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.255587042999998, 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:37.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:37.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:37.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.041201227999998, 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:37.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:37.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.039645708000002, 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:37.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:37.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:37.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.039153423999998, 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.038796593000001, 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.038362079999999, 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:37.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:37.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:37.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.928018966, 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.787 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:37.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:37.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:37.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927566063, 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:37.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:37.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:37.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:37.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:37.806 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927136038, 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:37.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:37.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:37.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927091259000001, 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:37.816 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:37.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:37.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:37.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927064108, 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:37.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:37.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:37.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:37.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:37.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927039533999999, 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:37.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:37.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.92702603, 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:37.845 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:37.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:37.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:37.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.927005959999999, 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:37.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:37.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.926791986000001, 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:37.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:37.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:37.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.920394395999999, 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:37.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.920012704000001, 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:37.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.882 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.919990004999999, 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:37.883 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:37.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:37.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:37.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.919727704, 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:37.891 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:37.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.919628377999999, 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:37.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:37.905 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:37.905 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:37.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:37.907 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:37.893+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:38.007 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:37.993+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:38.041 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-07-29T17:09:38.054 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.054 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T17:09:38.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:38.099 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2023-07-29T17:09:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T17:09:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T17:09:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T17:09:38.108 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:38.094+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:38.209 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.196+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.237 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.237 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:38.310 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.297+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-07-29T17:09:38.373 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.374 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.383 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:38.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-29T17:09:38.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T17:09:38.410 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.397+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.511 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.498+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.526 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.526 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.536 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:38.612 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.599+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.664 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.664 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:38.712 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:38.699+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:38.739 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-07-29T17:09:38.750 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2023-07-29T17:09:38.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:38.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-29T17:09:38.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[113917]: fuse finished with error 0 and tester_r 0 2023-07-29T17:09:38.792 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:09:38.801 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.801 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.811 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:38.812 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:38.799+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:38.913 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:38.899+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:38.945 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:38.945 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:38.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:39.037 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:39.024+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:39.115 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:39.102+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:39.121 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.121 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.132 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:39.215 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:39.203+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:39.354 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:39.341+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:39.389 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2023-07-29T17:09:39.417 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:39.404+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:39.455 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.455 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:39.518 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:39.505+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:39.619 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:39.606+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:39.633 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.633 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:39.719 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:39.707+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:39.770 INFO:teuthology.orchestra.run.smithi092.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.770 INFO:teuthology.orchestra.run.smithi092.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T17:09:39.820 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:39.807+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:39.920 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:39.907+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:39.928 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:39.928 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:39.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T17:09:40.021 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:40.008+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:40.066 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:40.066 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:40.076 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T17:09:40.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T17:09:40.122 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.108+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:40.202 INFO:teuthology.orchestra.run.smithi093.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:40.203 INFO:teuthology.orchestra.run.smithi093.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:40.212 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:40.256 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.243+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:40.323 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-07-29T17:09:40.310+0000 7f1876853700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 110228) UID: 0 2023-07-29T17:09:40.351 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:40.352 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:40.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:40.445 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.432+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:40.525 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:40.512+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:40.529 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:40.529 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:40.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:40.607 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T17:09:40.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T17:09:40.607 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2023-07-29T17:09:40.607 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:09:40.607 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-29T17:09:40.608 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T17:09:40.625 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.612+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:40.630 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-29T17:09:40.630 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:09:40.654 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T17:09:40.708 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:40.708 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:40.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:40.759 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.745+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:40.826 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:40.813+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:40.867 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:40.867 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:40.867 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:40.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:40.927 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:40.914+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:41.027 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:41.014+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:41.047 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:41.047 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:41.047 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:41.047 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:41.047 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:41.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:41.140 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:41.127+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:41.226 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:41.226 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.409821618999999, 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:41.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.228 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.228 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.228 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.228 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.229 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:41.230 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:41.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.232 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.233 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:41.234 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:41.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.234 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.234 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.234 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:41.235 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:41.236 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.40977788, 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.237 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:41.238 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.240 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.241 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.242 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.243 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.244 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.409678974000002, 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:41.246 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.247 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.247 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.247 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:41.247 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.248 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.248 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.248 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:41.249 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.249 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.249 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:41.250 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.251 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.252 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:41.253 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:41.254 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.409126168999997, 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:41.255 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.256 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.257 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.257 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:41.257 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.258 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.259 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:41.259 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:41.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.259 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.260 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.260 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:41.260 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:41.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.261 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.261 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.261 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:41.262 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:41.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.264 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.408393130999997, 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:41.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.266 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:41.267 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.268 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.269 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:41.270 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:41.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.270 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.270 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.270 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.271 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.272 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.273 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407412841999999, 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.274 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:41.275 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:41.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:41.278 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.279 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:41.280 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:41.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.282 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.283 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407375602999998, 2023-07-29T17:09:41.284 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.285 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.286 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:41.287 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.288 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:41.289 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:41.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.291 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:41.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.293 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.294 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407350334999997, 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.295 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:41.296 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.297 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.298 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.300 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:41.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.302 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.303 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.304 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.305 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407331784, 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.306 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.307 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.308 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.309 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:41.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.312 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.313 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:41.313 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:41.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.313 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.313 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.314 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:41.314 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:41.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.314 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.314 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.315 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:41.315 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:41.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.315 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.316 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.316 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:41.316 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:41.316 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.317 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.317 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.317 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.318 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.318 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:41.318 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407320570000003, 2023-07-29T17:09:41.318 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:41.319 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.319 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.319 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.320 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.321 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:41.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.323 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:41.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:41.325 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:41.327 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.328 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407309374, 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:41.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:41.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:41.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:41.335 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:41.336 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.337 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:41.338 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:41.339 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407290957000001, 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.340 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.342 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:41.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.344 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:41.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407263356000001, 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.349 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.350 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:41.352 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.353 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.354 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.407242959999998, 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.355 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:41.356 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:41.358 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.359 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:41.360 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.361 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.401708468000002, 2023-07-29T17:09:41.362 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.364 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:41.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.366 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.366 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:41.366 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:41.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.367 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.367 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:41.367 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:41.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.368 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:41.369 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.399256962000003, 2023-07-29T17:09:41.370 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.372 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.373 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:41.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.375 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.376 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:41.377 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:41.378 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.399226364, 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.379 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.381 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.382 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:41.382 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:41.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.382 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.383 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.383 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:41.383 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:41.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.384 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.384 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.384 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:41.384 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:41.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.385 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.385 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.385 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:41.385 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:41.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.399204744999999, 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:41.388 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.389 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.391 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.392 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:41.393 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.394 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:41.395 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.398055999999997, 2023-07-29T17:09:41.396 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:41.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.396 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:41.396 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.396 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.397 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.398 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:41.399 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:41.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.399 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.399 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:41.400 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.401 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:41.402 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:41.403 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 27.716389513999999, 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:41.406 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:41.413 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:41.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T17:09:41.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:41.416 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:41.401+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:41.515 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:41.502+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:41.549 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:41.549 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:41.559 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:41.641 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:41.628+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:41.717 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:41.703+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:41.726 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:41.726 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:41.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:41.818 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:41.805+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:41.903 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:41.903 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:41.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:41.954 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:41.940+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.019 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.006+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.044 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:42.044 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:42.045 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:42.045 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:42.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:42.119 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.106+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.181 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:42.182 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:42.182 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:42.182 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:42.182 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:42.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:42.235 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:42.222+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:42.321 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:42.321 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.504521343, 2023-07-29T17:09:42.322 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.324 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.324 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.324 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:42.324 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.325 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:42.326 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.327 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:42.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.329 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:42.330 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:42.331 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.504477604000002, 2023-07-29T17:09:42.331 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:42.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.333 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:42.334 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:42.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.336 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:42.337 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.338 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.339 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.504378697999996, 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.340 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.341 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.343 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.344 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.345 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.503825892999998, 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.347 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.348 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:42.349 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.350 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:42.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.352 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:42.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.503092854999998, 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:42.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:42.356 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.357 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:42.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.359 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:42.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.361 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.362 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502112566000001, 2023-07-29T17:09:42.363 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.365 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.366 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.368 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:42.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.370 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.371 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.372 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.373 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502075327, 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.374 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:42.375 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.377 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.377 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.377 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:42.377 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:42.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.378 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:42.380 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.381 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:42.383 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:42.384 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.384 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.384 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.384 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502050058999998, 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.385 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.386 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.387 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.388 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.389 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.389 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:42.389 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:42.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.390 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.391 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:42.391 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:42.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.391 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.391 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.392 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:42.392 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:42.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.393 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.393 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:42.393 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:42.393 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:42.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.394 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.394 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.394 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:42.394 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:42.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.395 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.395 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.395 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:42.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.397 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.397 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.397 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:42.397 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:42.398 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502031508000002, 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.399 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:42.400 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:42.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.403 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:42.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.405 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:42.406 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:42.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.408 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502020293999998, 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:42.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.411 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:42.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.414 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:42.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:42.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.502009098000002, 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.419 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.420 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:42.422 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.423 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:42.424 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.425 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:42.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.427 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.428 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.501990681000002, 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.429 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:42.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.432 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:42.433 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.434 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.435 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.501963080000003, 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.436 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.438 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.440 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.441 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.442 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.501942683999999, 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.443 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:42.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:42.446 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:42.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.496408191999997, 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.450 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.451 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.452 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:42.453 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.454 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:42.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.456 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.493956685999997, 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.458 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.460 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.461 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:42.462 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.463 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.493926088000002, 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.465 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:42.466 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.467 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:42.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.469 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.470 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.493904469, 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:42.471 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.472 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:42.473 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.474 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:42.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.476 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.477 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 33.492755723999998, 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:42.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.480 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.481 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:42.482 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.484 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 28.811089238000001, 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.485 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:42.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.488 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:42.489 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.490 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:42.491 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.492 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:42.493 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.494 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.494 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.494 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:42.494 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:42.494 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:42.495 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2023-07-29T17:09:42.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:42.497 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.482+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.596 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:42.583+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:42.628 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:42.628 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:42.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:42.697 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.683+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.766 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:42.767 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:42.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:42.818 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.805+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.898 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:42.885+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:42.945 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:42.945 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:42.955 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:42.999 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:42.986+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:43.089 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:43.089 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:43.089 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:43.090 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:43.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:43.139 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:43.126+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:43.201 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:43.188+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:43.265 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:43.265 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:43.266 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:43.266 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:43.266 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:43.275 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:43.302 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:43.289+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:43.402 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:43.402 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:43.402 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:43.402 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.585810539999997, 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.403 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.404 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:43.405 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.406 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:43.407 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:43.409 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.585766800999998, 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:43.413 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.414 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:43.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.416 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.585667895, 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.419 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:43.421 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.422 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:43.423 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.424 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.425 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.585115090000002, 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.426 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.428 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:43.429 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.430 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:43.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.432 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.433 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.584382052000002, 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.434 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.435 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.437 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.439 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.440 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583401762999998, 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.442 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.443 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:43.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.445 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:43.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.447 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:43.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.449 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.450 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.451 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583364523999997, 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.452 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.453 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.455 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.456 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.457 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.458 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:43.459 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:43.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.461 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583339256000002, 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:43.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.464 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.465 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.466 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:43.468 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.469 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:43.470 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.471 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583320704999998, 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:43.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.473 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:43.474 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.475 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:43.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.477 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:43.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.479 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.480 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.481 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583309491000001, 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.482 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.483 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:43.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.485 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:43.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.487 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:43.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.489 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:43.490 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.491 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583298294999999, 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:43.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:43.494 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:43.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.496 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:43.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:43.498 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.499 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.500 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.501 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583279877999999, 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:43.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.503 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.505 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:43.506 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.507 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:43.508 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:43.509 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583252277, 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:43.510 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.511 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.513 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:43.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.515 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.516 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.583231881000003, 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.517 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.519 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.520 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:43.521 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.522 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.523 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.577697389000001, 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.524 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.525 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:43.527 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.528 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.529 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.530 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.575245883000001, 2023-07-29T17:09:43.531 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.532 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.533 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:43.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.535 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:43.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.538 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.575215284999999, 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.539 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:43.540 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.541 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:43.542 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:43.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.575193665999997, 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:43.546 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.547 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:43.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.549 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.550 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:43.551 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 34.574044921000002, 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:43.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.555 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:43.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.557 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:43.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 29.892378435000001, 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:43.560 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:43.561 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:43.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:43.563 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.564 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:43.565 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.566 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:43.567 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:43.568 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.569 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.570 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.570 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:43.570 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:43.570 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:43.571 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:43.558+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:43.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:43.672 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:43.659+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:43.702 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:43.702 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:43.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:43.773 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:43.760+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:43.840 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:43.840 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:43.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:43.891 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:43.877+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:43.975 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:43.962+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.017 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:44.017 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:44.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:44.075 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.062+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.163 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:44.163 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:44.164 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:44.164 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:44.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:44.175 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2023-07-29T17:09:44.215 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.201+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.276 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.262+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.341 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:44.341 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:44.341 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:44.342 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:44.342 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:44.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:44.392 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.378+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.477 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.463+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T17:09:44.521 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:44.522 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.705258121, 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:44.523 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.524 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:44.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.526 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:44.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.528 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:44.529 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:44.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.529 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.705214382000001, 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.534 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.535 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.537 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.538 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:44.539 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.540 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.541 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.705115476000003, 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.542 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.544 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:44.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.546 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:44.547 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:44.548 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.704562670999998, 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:44.549 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.550 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:44.551 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.552 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:44.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.554 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:44.555 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.703829632999998, 2023-07-29T17:09:44.556 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.558 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.559 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.560 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.561 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:44.562 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.563 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702849344000001, 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.564 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.565 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:44.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.567 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:44.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.569 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.570 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.571 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:44.572 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:44.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.572 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.572 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.572 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.573 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702812105, 2023-07-29T17:09:44.574 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.576 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:44.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.578 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.579 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:44.580 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.581 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:44.582 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702786836999998, 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.584 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.585 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.587 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:44.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.589 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.590 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:44.591 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.592 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.593 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702768286000001, 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.594 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:44.595 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.596 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:44.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.598 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.599 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.600 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:44.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.602 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.603 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702757071999997, 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.604 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.607 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.608 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.609 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:44.610 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.611 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.612 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.613 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702745876000002, 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.614 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:44.615 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.616 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.617 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:44.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.619 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:44.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.621 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.622 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.623 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702727459000002, 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.624 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.626 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.627 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.628 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.629 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.630 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702699858000003, 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:44.631 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.632 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.633 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:44.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.635 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.636 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:44.637 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:44.638 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.702679461999999, 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:44.639 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.640 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:44.641 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.642 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:44.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.644 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.645 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.697144969999997, 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.646 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.647 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.649 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:44.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.651 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:44.652 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.694693463999997, 2023-07-29T17:09:44.653 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.655 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.656 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.657 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.658 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:44.659 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:44.660 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.694662866000002, 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:44.661 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.662 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:44.663 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.664 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:44.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.666 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:44.667 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.694641247, 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.668 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.670 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.671 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:44.672 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 35.693492501999998, 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:44.675 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.676 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:44.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.678 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.679 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:44.680 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:44.681 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 31.011826016000001, 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:44.682 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.683 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:44.684 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.685 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:44.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:44.687 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.688 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:44.689 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.690 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.691 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:44.691 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:44.691 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:44.691 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:09:44.703 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:44.679+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:44.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:44.793 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.780+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.803 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T17:09:44.835 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:44.835 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:44.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:44.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T17:09:44.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:44.894 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-29T17:09:44.895 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.881+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:44.929 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-07-29T17:09:44.974 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:44.975 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:44.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:44.987 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-29T17:09:44.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:44.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-29T17:09:44.995 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:09:44.982+0000 7f3543c9b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:09:45.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:09:45.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-07-29T17:09:45.096 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:09:45.082+0000 7f524acab700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:09:45.112 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2023-07-29T17:09:45.112 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T17:09:45.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T17:09:45.162 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-07-29T17:09:45.172 INFO:tasks.thrashosds:joining thrashosds 2023-07-29T17:09:45.255 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:45.256 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:45.256 INFO:teuthology.orchestra.run.smithi092.stdout: "num_ops": 0 2023-07-29T17:09:45.256 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:45.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T17:09:45.393 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:45.394 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [], 2023-07-29T17:09:45.394 INFO:teuthology.orchestra.run.smithi092.stdout: "complaint_time": 30, 2023-07-29T17:09:45.394 INFO:teuthology.orchestra.run.smithi092.stdout: "num_blocked_ops": 0 2023-07-29T17:09:45.394 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:45.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T17:09:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2023-07-29T17:09:45.534 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-07-29T17:09:45.534 INFO:teuthology.orchestra.run.smithi092.stdout: "size": 20, 2023-07-29T17:09:45.534 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 600, 2023-07-29T17:09:45.534 INFO:teuthology.orchestra.run.smithi092.stdout: "ops": [ 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.717654291999999, 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045371589999999998, 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.535 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.536 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802738+0000", 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.537 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802737+0000", 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802744+0000", 2023-07-29T17:09:45.538 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.9650000000000002e-06 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802755+0000", 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0236e-05 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.539 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.540 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.540 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802773+0000", 2023-07-29T17:09:45.540 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.8264999999999999e-05 2023-07-29T17:09:45.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.541 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.541 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.541 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803294+0000", 2023-07-29T17:09:45.541 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00052161799999999995 2023-07-29T17:09:45.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.542 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.542 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.542 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803320+0000", 2023-07-29T17:09:45.542 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.597e-05 2023-07-29T17:09:45.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807240+0000", 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0039191979999999996 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.543 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5227e-05 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.544 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.717610553, 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004526085, 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.545 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.546 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802781+0000", 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.548 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.548 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.548 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802800+0000", 2023-07-29T17:09:45.548 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.9250999999999999e-05 2023-07-29T17:09:45.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.549 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.549 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.549 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802954+0000", 2023-07-29T17:09:45.549 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00015361500000000001 2023-07-29T17:09:45.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.550 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.550 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.550 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802961+0000", 2023-07-29T17:09:45.551 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5440000000000001e-06 2023-07-29T17:09:45.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.551 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.551 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.551 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803461+0000", 2023-07-29T17:09:45.552 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00049970600000000004 2023-07-29T17:09:45.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.552 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.552 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.552 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803658+0000", 2023-07-29T17:09:45.553 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00019695499999999999 2023-07-29T17:09:45.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.553 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.553 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.553 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807275+0000", 2023-07-29T17:09:45.554 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.003616602 2023-07-29T17:09:45.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.554 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.554 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.554 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807307+0000", 2023-07-29T17:09:45.555 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2895999999999998e-05 2023-07-29T17:09:45.555 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.555 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.555 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.556 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:45.556 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:45.556 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.717511647000002, 2023-07-29T17:09:45.557 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.004244037, 2023-07-29T17:09:45.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:45.557 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.557 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.558 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.558 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:45.558 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.558 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.559 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.559 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:45.559 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.559 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.560 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.560 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802880+0000", 2023-07-29T17:09:45.560 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.560 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.561 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.561 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802893+0000", 2023-07-29T17:09:45.561 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2880999999999999e-05 2023-07-29T17:09:45.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.561 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.562 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.562 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802907+0000", 2023-07-29T17:09:45.562 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3925e-05 2023-07-29T17:09:45.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.562 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.563 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.563 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802920+0000", 2023-07-29T17:09:45.563 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2894999999999999e-05 2023-07-29T17:09:45.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.563 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.564 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.564 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.802974+0000", 2023-07-29T17:09:45.564 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3961000000000001e-05 2023-07-29T17:09:45.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.565 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.565 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.565 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807124+0000", 2023-07-29T17:09:45.565 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0041507879999999999 2023-07-29T17:09:45.565 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.566 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.566 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.566 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.566 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.716958841999997, 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0068749359999999999, 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.567 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.568 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.569 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803433+0000", 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803446+0000", 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.379e-05 2023-07-29T17:09:45.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.803456+0000", 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.7499999999999998e-06 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.571 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804001+0000", 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054483299999999999 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804213+0000", 2023-07-29T17:09:45.572 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021211099999999999 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804825+0000", 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00061164699999999999 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.573 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810268+0000", 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0054434899999999996 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810308+0000", 2023-07-29T17:09:45.574 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9845999999999998e-05 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop(mds.0.3:33 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.716225803999997, 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033000989999999999, 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.576 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804166+0000", 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.578 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804173+0000", 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.7100000000000007e-06 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.579 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804199+0000", 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5249000000000002e-05 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804207+0000", 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.9539999999999993e-06 2023-07-29T17:09:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804378+0000", 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00017030999999999999 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.581 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.804399+0000", 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.1194000000000001e-05 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807429+0000", 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0030303270000000002 2023-07-29T17:09:45.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807466+0000", 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6909000000000002e-05 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715245514999999, 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0084991440000000001, 2023-07-29T17:09:45.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805146+0000", 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.586 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805140+0000", 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999933 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805152+0000", 2023-07-29T17:09:45.587 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.2663999999999999e-05 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805161+0000", 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8859999999999993e-06 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.588 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805168+0000", 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.7299999999999999e-06 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805210+0000", 2023-07-29T17:09:45.589 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.2373999999999998e-05 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805326+0000", 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000115117 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.590 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805478+0000", 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000152805 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.591 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807630+0000", 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.002151928 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813554+0000", 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0059233319999999999 2023-07-29T17:09:45.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813601+0000", 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6878000000000001e-05 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.593 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813646+0000", 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.507e-05 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.594 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715208275999998, 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0085899270000000007, 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.595 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.596 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805184+0000", 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805183+0000", 2023-07-29T17:09:45.597 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805187+0000", 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6210000000000001e-06 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.598 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805193+0000", 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.7769999999999999e-06 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805203+0000", 2023-07-29T17:09:45.599 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.0881e-05 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805801+0000", 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00059736499999999998 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.600 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805925+0000", 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012447700000000001 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.601 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806048+0000", 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012244299999999999 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810359+0000", 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043114080000000001 2023-07-29T17:09:45.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813687+0000", 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0033281859999999999 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.603 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813737+0000", 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.9438000000000003e-05 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813774+0000", 2023-07-29T17:09:45.604 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.6874e-05 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.605 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715183007999997, 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0058316369999999998, 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.606 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:45.607 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805209+0000", 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.608 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805217+0000", 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.9119999999999998e-06 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.609 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805221+0000", 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3200000000000001e-06 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805224+0000", 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0230000000000001e-06 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.610 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805790+0000", 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056582300000000002 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.611 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805920+0000", 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00012981399999999999 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806063+0000", 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00014378700000000001 2023-07-29T17:09:45.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810366+0000", 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0043024090000000001 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.613 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810935+0000", 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00056975500000000002 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810989+0000", 2023-07-29T17:09:45.614 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.3934000000000002e-05 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811041+0000", 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1153000000000003e-05 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.615 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715164457, 2023-07-29T17:09:45.616 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.006863035, 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:45.617 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.618 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805227+0000", 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805230+0000", 2023-07-29T17:09:45.619 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.667e-06 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805233+0000", 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4630000000000001e-06 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.620 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805236+0000", 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9009999999999998e-06 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.621 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806395+0000", 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001159329 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.8721000000000003e-05 2023-07-29T17:09:45.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 2", 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806515+0000", 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0936e-05 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.623 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810372+0000", 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0038573570000000001 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812033+0000", 2023-07-29T17:09:45.624 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001660204 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812067+0000", 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.4539000000000003e-05 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.625 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.812091+0000", 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.3380999999999999e-05 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715153243000003, 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087703999999999994, 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.627 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.628 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805239+0000", 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805238+0000", 2023-07-29T17:09:45.629 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805241+0000", 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.6249999999999999e-06 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.630 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805244+0000", 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.2959999999999999e-06 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.631 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805247+0000", 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8890000000000002e-06 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806387+0000", 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001139625 2023-07-29T17:09:45.632 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806478+0000", 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.1082000000000006e-05 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.633 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806564+0000", 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.5838e-05 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811120+0000", 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0045559010000000002 2023-07-29T17:09:45.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813927+0000", 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0028076690000000001 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.635 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813971+0000", 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.4002999999999999e-05 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814009+0000", 2023-07-29T17:09:45.636 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7707000000000003e-05 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.637 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715142047000001, 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0093623709999999995, 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.638 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:45.639 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805250+0000", 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.640 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805251+0000", 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.787e-06 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.641 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805255+0000", 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.0680000000000001e-06 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805257+0000", 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9679999999999998e-06 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.642 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805301+0000", 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3761999999999999e-05 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.643 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805407+0000", 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000105278 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805503+0000", 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.6460999999999997e-05 2023-07-29T17:09:45.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.807622+0000", 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021189109999999998 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.645 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814543+0000", 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0069213670000000003 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814579+0000", 2023-07-29T17:09:45.646 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5389999999999998e-05 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814612+0000", 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.3599000000000001e-05 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.647 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715123630000001, 2023-07-29T17:09:45.648 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0094492259999999998, 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.650 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805268+0000", 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805270+0000", 2023-07-29T17:09:45.651 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.967e-06 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805274+0000", 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.0219999999999998e-06 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.652 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805277+0000", 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.9610000000000001e-06 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.653 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805789+0000", 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00051244699999999997 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805927+0000", 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000137818 2023-07-29T17:09:45.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814718+0000", 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0087903709999999999 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.655 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715096029000001, 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0092688630000000004, 2023-07-29T17:09:45.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.658 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805296+0000", 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805300+0000", 2023-07-29T17:09:45.659 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.3039999999999998e-06 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805304+0000", 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6149999999999999e-06 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.660 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805313+0000", 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806833+0000", 2023-07-29T17:09:45.661 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.001519846 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.806965+0000", 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013223099999999999 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.662 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814565+0000", 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0075998319999999999 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:34 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.715075632999998, 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0065923559999999997, 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.664 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.665 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.666 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805316+0000", 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805321+0000", 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.1789999999999999e-06 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.667 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805325+0000", 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.5820000000000002e-06 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.668 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805327+0000", 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7329999999999999e-06 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805356+0000", 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.8895999999999999e-05 2023-07-29T17:09:45.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.805440+0000", 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.3990000000000001e-05 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.670 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811909+0000", 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0064684260000000002 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.671 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:18 3.7 e18/16 ondisk, result = 0)", 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.709541141000003, 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00020098699999999999, 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.672 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.673 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810851+0000", 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810850+0000", 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810854+0000", 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9509999999999999e-06 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.675 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810863+0000", 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.6130000000000004e-06 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810875+0000", 2023-07-29T17:09:45.676 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.1867e-05 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810915+0000", 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.9949e-05 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.677 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.810923+0000", 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.721e-06 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.678 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.811052+0000", 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128295 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.679 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.707089635000003, 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00035013200000000001, 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.680 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.681 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813302+0000", 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813305+0000", 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.196e-06 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.683 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813311+0000", 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.8699999999999997e-06 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813318+0000", 2023-07-29T17:09:45.684 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.0380000000000002e-06 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813534+0000", 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021603400000000001 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.685 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813547+0000", 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.3400999999999999e-05 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813652+0000", 2023-07-29T17:09:45.686 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000104975 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:45.687 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.707059037000001, 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00045010100000000001, 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.688 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:45.689 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813333+0000", 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.690 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813335+0000", 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.7640000000000001e-06 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813341+0000", 2023-07-29T17:09:45.691 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.6999999999999996e-06 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813346+0000", 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.5190000000000003e-06 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.692 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813675+0000", 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00032941900000000001 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.693 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813683+0000", 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.5279999999999998e-06 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813783+0000", 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000100441 2023-07-29T17:09:45.694 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_repop_reply(mds.0.3:19 3.1f e18/16 ondisk, result = 0)", 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:45.695 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.707037417999999, 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066259499999999998, 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "started", 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813355+0000", 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.697 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813354+0000", 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.698 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813357+0000", 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5519999999999999e-06 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813363+0000", 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 6.1820000000000003e-06 2023-07-29T17:09:45.699 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813368+0000", 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.7670000000000003e-06 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.700 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813913+0000", 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00054498000000000003 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.813922+0000", 2023-07-29T17:09:45.701 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 8.8130000000000002e-06 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814017+0000", 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 9.5589999999999998e-05 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.702 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 3 lcod 18'2)", 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 36.705888672999997, 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00021838000000000001, 2023-07-29T17:09:45.703 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "reached pg", 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.705 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814503+0000", 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967296 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814506+0000", 2023-07-29T17:09:45.706 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 2.5270000000000001e-06 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814511+0000", 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.5419999999999996e-06 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.707 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814515+0000", 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.7670000000000001e-06 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.708 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814643+0000", 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000128367 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:08.814722+0000", 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 7.8407999999999999e-05 2023-07-29T17:09:45.709 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: "initiated_at": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:45.710 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 32.024222186999999, 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.0021181260000000001, 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "type_data": { 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "events": [ 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "initiated", 2023-07-29T17:09:45.711 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "throttled", 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496170+0000", 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0 2023-07-29T17:09:45.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "header_read", 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496167+0000", 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4294967295.9999976 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "all_read", 2023-07-29T17:09:45.713 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496182+0000", 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.4643e-05 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "dispatched", 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496213+0000", 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 3.1279000000000003e-05 2023-07-29T17:09:45.714 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "queued_for_pg", 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496231+0000", 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 1.7390000000000001e-05 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.715 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "reached_pg", 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496362+0000", 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00013106000000000001 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "started", 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496646+0000", 2023-07-29T17:09:45.716 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00028401199999999999 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.496776+0000", 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.000130068 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.717 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "op_commit", 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.497524+0000", 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00074854299999999995 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:45.718 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498186+0000", 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 0.00066199300000000004 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "commit_sent", 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498233+0000", 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 4.6869000000000001e-05 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2023-07-29T17:09:45.719 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: "event": "done", 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: "time": "2023-07-29T17:09:13.498288+0000", 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: "duration": 5.4589000000000002e-05 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.720 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-07-29T17:09:45.721 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2023-07-29T17:09:45.721 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-07-29T17:09:45.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T17:09:45.854 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:45.854 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2023-07-29T17:09:45.855 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:45.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T17:09:45.899 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2023-07-29T17:09:45.900 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T17:09:45.900 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-07-29T17:09:45.900 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T17:09:45.902 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T17:09:45.903 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T17:09:45.993 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:45.993 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2023-07-29T17:09:45.994 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2023-07-29T17:09:45.994 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2023-07-29T17:09:45.994 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:46.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T17:09:46.133 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-07-29T17:09:46.133 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2023-07-29T17:09:46.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2023-07-29T17:09:46.133 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:84 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'54, mlcod=11'50)", 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.648398489999998, 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055626219999999997, 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.134 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470812+0000", 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470811+0000", 2023-07-29T17:09:46.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470876+0000", 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470884+0000", 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8490000000000006e-06 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470889+0000", 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2023-07-29T17:09:46.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470920+0000", 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1087999999999998e-05 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.470939+0000", 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9159000000000001e-05 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476326+0000", 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053875640000000001 2023-07-29T17:09:46.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.476374+0000", 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7956e-05 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:134 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'92, mlcod=11'87)", 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.434012674999998, 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052671970000000004, 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.142 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685198+0000", 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685197+0000", 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685231+0000", 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3905000000000001e-05 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685239+0000", 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685245+0000", 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6830000000000002e-06 2023-07-29T17:09:46.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685278+0000", 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2941999999999997e-05 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.685297+0000", 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9287999999999999e-05 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690438+0000", 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051409280000000003 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690465+0000", 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6367e-05 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:137 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'95, mlcod=11'90)", 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.432457155000002, 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058108559999999997, 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.150 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686753+0000", 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686802+0000", 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000003e-05 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686807+0000", 2023-07-29T17:09:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5060000000000003e-06 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686811+0000", 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4529999999999998e-06 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686844+0000", 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3353999999999999e-05 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.686864+0000", 2023-07-29T17:09:46.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0115999999999998e-05 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692542+0000", 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056775200000000001 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692564+0000", 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2132000000000001e-05 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:138 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'96, mlcod=11'90)", 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.431964870999998, 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054376909999999997, 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687245+0000", 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687249+0000", 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3239999999999996e-06 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687256+0000", 2023-07-29T17:09:46.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.956e-06 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687260+0000", 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8489999999999999e-06 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689863+0000", 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026032859999999998 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.689885+0000", 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579000000000001e-05 2023-07-29T17:09:46.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692641+0000", 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027563760000000001 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692683+0000", 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1822e-05 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:139 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'97, mlcod=11'90)", 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.43160804, 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051019380000000003, 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:46.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687602+0000", 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687605+0000", 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8159999999999998e-06 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687610+0000", 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7520000000000002e-06 2023-07-29T17:09:46.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.687613+0000", 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0589999999999998e-06 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690195+0000", 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025815920000000002 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690215+0000", 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0248999999999999e-05 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692685+0000", 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024695089999999999 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692704+0000", 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9279999999999998e-05 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4179.0:140 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'98, mlcod=11'90)", 2023-07-29T17:09:46.173 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.431173526999999, 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049266500000000003, 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688037+0000", 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688035+0000", 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688087+0000", 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2318999999999998e-05 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688113+0000", 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5760000000000001e-05 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.688126+0000", 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3056e-05 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690553+0000", 2023-07-29T17:09:46.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024265369999999999 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.690565+0000", 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692947+0000", 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002381804 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:08:58.692963+0000", 2023-07-29T17:09:46.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6506000000000001e-05 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:46.181 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.320830413000003, 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011390402000000001, 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:46.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798380+0000", 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798374+0000", 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999943 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798393+0000", 2023-07-29T17:09:46.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9239e-05 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798406+0000", 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2835e-05 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798420+0000", 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4059999999999999e-05 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799528+0000", 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001107902 2023-07-29T17:09:46.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799672+0000", 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014348799999999999 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799853+0000", 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109499999999999 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803419+0000", 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035660209999999999 2023-07-29T17:09:46.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809681+0000", 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00626277 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809728+0000", 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6377e-05 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809770+0000", 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2345999999999997e-05 2023-07-29T17:09:46.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.32037751, 2023-07-29T17:09:46.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011105985000000001, 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798833+0000", 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798832+0000", 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.798837+0000", 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2789999999999998e-06 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799202+0000", 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000365235 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799250+0000", 2023-07-29T17:09:46.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7638e-05 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799575+0000", 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032500500000000001 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799965+0000", 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000389622 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.800120+0000", 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015537099999999999 2023-07-29T17:09:46.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803423+0000", 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033027519999999999 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809815+0000", 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063924109999999998 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809882+0000", 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7200999999999996e-05 2023-07-29T17:09:46.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809939+0000", 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6230000000000002e-05 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319947485, 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010838924999999999, 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799263+0000", 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799262+0000", 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:46.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799274+0000", 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2258e-05 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799285+0000", 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1231e-05 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799294+0000", 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4100000000000008e-06 2023-07-29T17:09:46.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799435+0000", 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014082499999999999 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799722+0000", 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000287108 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799874+0000", 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015248 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.802976+0000", 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101777 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.809980+0000", 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070038679999999999 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810057+0000", 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6941999999999996e-05 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810102+0000", 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4836000000000002e-05 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319902706000001, 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014287971999999999, 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799308+0000", 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799307+0000", 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799312+0000", 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4609999999999999e-06 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799321+0000", 2023-07-29T17:09:46.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0210000000000005e-06 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799328+0000", 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6329999999999999e-06 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803536+0000", 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042084590000000003 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803613+0000", 2023-07-29T17:09:46.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6693000000000006e-05 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803702+0000", 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9266999999999998e-05 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804644+0000", 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094138700000000002 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813540+0000", 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088957610000000003 2023-07-29T17:09:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813573+0000", 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3773999999999999e-05 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813595+0000", 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2180000000000001e-05 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319875555000003, 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014367464999999999, 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799335+0000", 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799334+0000", 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799338+0000", 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-06 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799348+0000", 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0261000000000001e-05 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799356+0000", 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2169999999999997e-06 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803565+0000", 2023-07-29T17:09:46.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042098730000000003 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803645+0000", 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9482999999999998e-05 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803735+0000", 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9834999999999996e-05 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804651+0000", 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00091615499999999999 2023-07-29T17:09:46.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813602+0000", 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089511699999999996 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813653+0000", 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1365e-05 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813702+0000", 2023-07-29T17:09:46.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8708000000000002e-05 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319850981000002, 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011160137000000001, 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:46.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799359+0000", 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799361+0000", 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4760000000000001e-06 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799366+0000", 2023-07-29T17:09:46.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4190000000000004e-06 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799369+0000", 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801224+0000", 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018545409999999999 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801323+0000", 2023-07-29T17:09:46.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9166999999999994e-05 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.801809+0000", 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048570699999999999 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803283+0000", 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001474321 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810160+0000", 2023-07-29T17:09:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068764539999999997 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810467+0000", 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030741500000000001 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.810519+0000", 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2290999999999998e-05 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319837477, 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014335338, 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:46.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799373+0000", 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799375+0000", 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.593e-06 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799379+0000", 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6100000000000002e-06 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799388+0000", 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8850000000000005e-06 2023-07-29T17:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803876+0000", 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044883750000000002 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.803944+0000", 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8522000000000006e-05 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.804030+0000", 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5229999999999995e-05 2023-07-29T17:09:46.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807479+0000", 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034492640000000001 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813626+0000", 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006146632 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813662+0000", 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6261999999999999e-05 2023-07-29T17:09:46.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.813708+0000", 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6198000000000001e-05 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319817407000002, 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095064169999999996, 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:46.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799393+0000", 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799392+0000", 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799395+0000", 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5600000000000001e-06 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799402+0000", 2023-07-29T17:09:46.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6200000000000001e-06 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799408+0000", 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7959999999999998e-06 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799707+0000", 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000299127 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799848+0000", 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140421 2023-07-29T17:09:46.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808899+0000", 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0090513729999999997 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.319603432999997, 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087903930000000005, 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799607+0000", 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799606+0000", 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:46.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799611+0000", 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1309999999999997e-06 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799621+0000", 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159999999999999e-05 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799631+0000", 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.499e-06 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799846+0000", 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021588999999999999 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.799976+0000", 2023-07-29T17:09:46.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012985500000000001 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.808397+0000", 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084208700000000004 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.313205842999999, 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051675890000000002, 2023-07-29T17:09:46.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806004+0000", 2023-07-29T17:09:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806010+0000", 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8039999999999998e-06 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806024+0000", 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4408e-05 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806033+0000", 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0399999999999998e-06 2023-07-29T17:09:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806178+0000", 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144568 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806929+0000", 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00075076899999999998 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811139+0000", 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042100929999999998 2023-07-29T17:09:46.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811172+0000", 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3220999999999999e-05 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.312824151000001, 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053687179999999998, 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806386+0000", 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806385+0000", 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806394+0000", 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0630000000000006e-06 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806406+0000", 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2677000000000001e-05 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806418+0000", 2023-07-29T17:09:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2223e-05 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806561+0000", 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014207400000000001 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811755+0000", 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051942739999999996 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.312801452000002, 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048884130000000003, 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806409+0000", 2023-07-29T17:09:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806408+0000", 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806427+0000", 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8697000000000001e-05 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806436+0000", 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2890000000000003e-06 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806444+0000", 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5730000000000002e-06 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807555+0000", 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001111555 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807575+0000", 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0013999999999998e-05 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811261+0000", 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036852159999999998 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811297+0000", 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6498000000000002e-05 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.312539151000003, 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005272573, 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T17:09:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806671+0000", 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806670+0000", 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2023-07-29T17:09:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806701+0000", 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0614000000000002e-05 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806726+0000", 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5367999999999998e-05 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806734+0000", 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8779999999999998e-06 2023-07-29T17:09:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807038+0000", 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030421499999999999 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2023-07-29T17:09:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807065+0000", 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6872999999999998e-05 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811911+0000", 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048461709999999998 2023-07-29T17:09:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811944+0000", 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2400999999999997e-05 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 171 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:26 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.312439824999998, 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049662509999999997, 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2023-07-29T17:09:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806770+0000", 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2023-07-29T17:09:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806777+0000", 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2023-07-29T17:09:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806788+0000", 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1354e-05 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.806800+0000", 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.172e-05 2023-07-29T17:09:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.807913+0000", 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00111294 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2023-07-29T17:09:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-07-29T17:09:08.811737+0000", 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00382352 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-07-29T17:09:46.302 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-07-29T17:09:47.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T17:09:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2023-07-29T17:09:48.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T17:09:48.804 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:09:48.915 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T17:09:49.017 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-29T17:09:49.488 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2023-07-29T17:09:50.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-07-29T17:09:54.118 INFO:tasks.thrashosds.thrasher:reviving osd 2023-07-29T17:09:54.119 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2023-07-29T17:09:54.119 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:09:54.119 INFO:teuthology.orchestra.console.smithi093:Power on 2023-07-29T17:09:54.119 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T17:09:54.142 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-07-29T17:09:54.143 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:09:54.167 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T17:09:55.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2023-07-29T17:09:58.168 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:09:58.280 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T17:10:01.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2023-07-29T17:10:02.282 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:10:02.393 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T17:10:02.494 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-07-29T17:10:02.596 DEBUG:teuthology.orchestra.console.smithi093:Waiting for login prompt 2023-07-29T17:10:02.596 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi093 2023-07-29T17:10:07.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~17s 2023-07-29T17:10:13.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2023-07-29T17:10:19.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2023-07-29T17:10:24.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-07-29T17:10:30.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2023-07-29T17:10:36.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~46s 2023-07-29T17:10:42.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~52s 2023-07-29T17:10:48.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~58s 2023-07-29T17:10:48.426 INFO:teuthology.orchestra.console.smithi093:Failed to get ipmi console status: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte 2023-07-29T17:10:48.528 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1403, in _do_thrash self.all_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 788, in all_up self.revive_osd() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 558, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 3030, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.1 via ipmi 2023-07-29T17:10:48.529 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1269, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1403, in _do_thrash self.all_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 788, in all_up self.revive_osd() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 558, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 3030, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.1 via ipmi 2023-07-29T17:10:48.529 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-07-29T17:10:48.529 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-07-29T17:10:48.529 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-07-29T17:10:48.530 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-07-29T17:10:48.530 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-29T17:10:48.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:10:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:10:48.866 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":29,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:49.460621+0000","last_up_change":"2023-07-29T17:09:44.382958+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:10:51.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:10:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-29T17:10:52.208 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":29,"fsid":"a332a6fa-930f-490b-a8e4-4300ea7abc2a","created":"2023-07-29T17:08:46.582422+0000","modified":"2023-07-29T17:09:49.460621+0000","last_up_change":"2023-07-29T17:09:44.382958+0000","last_in_change":"2023-07-29T17:08:47.499348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T17:08:56.668318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T17:09:01.905239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T17:09:06.456697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T17:09:07.770105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973204e3-f1bb-4f6b-8c6a-d2548ecfc4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":110190},{"type":"v1","addr":"172.21.15.92:6801","nonce":110190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":110190},{"type":"v1","addr":"172.21.15.92:6803","nonce":110190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":110190},{"type":"v1","addr":"172.21.15.92:6807","nonce":110190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":110190},{"type":"v1","addr":"172.21.15.92:6805","nonce":110190}]},"public_addr":"172.21.15.92:6801/110190","cluster_addr":"172.21.15.92:6803/110190","heartbeat_back_addr":"172.21.15.92:6807/110190","heartbeat_front_addr":"172.21.15.92:6805/110190","state":["exists","up"]},{"osd":1,"uuid":"ee52c2b3-837b-4ab3-8826-4fae9cff4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":110230},{"type":"v1","addr":"172.21.15.93:6801","nonce":110230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":110230},{"type":"v1","addr":"172.21.15.93:6803","nonce":110230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":110230},{"type":"v1","addr":"172.21.15.93:6807","nonce":110230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":110230},{"type":"v1","addr":"172.21.15.93:6805","nonce":110230}]},"public_addr":"172.21.15.93:6801/110230","cluster_addr":"172.21.15.93:6803/110230","heartbeat_back_addr":"172.21.15.93:6807/110230","heartbeat_front_addr":"172.21.15.93:6805/110230","state":["exists"]},{"osd":2,"uuid":"940667e0-3fe5-459e-8934-96e6b34a39ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":110381},{"type":"v1","addr":"172.21.15.153:6801","nonce":110381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":110381},{"type":"v1","addr":"172.21.15.153:6803","nonce":110381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":110381},{"type":"v1","addr":"172.21.15.153:6807","nonce":110381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":110381},{"type":"v1","addr":"172.21.15.153:6805","nonce":110381}]},"public_addr":"172.21.15.153:6801/110381","cluster_addr":"172.21.15.153:6803/110381","heartbeat_back_addr":"172.21.15.153:6807/110381","heartbeat_front_addr":"172.21.15.153:6805/110381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.602217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.550112+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T17:08:52.537070+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T17:10:53.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2023-07-29T17:10:53.950 INFO:tasks.daemonwatchdog.daemon_watchdog:OSDThrasher failed 2023-07-29T17:10:53.950 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-29T17:10:53.951 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-07-29T17:10:53.951 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T17:10:53.974 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251120k,nr_inodes=4062780,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16113 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253744k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-07-29T17:10:53.975 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-07-29T17:10:53.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T17:10:53.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T17:10:53.975 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-29T17:10:54.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:10:54.036 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-07-29T17:10:54.841 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-29T17:10:54.842 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-29T17:10:54.843 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-29T17:10:54.843 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-29T17:10:54.844 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-29T17:10:54.844 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-29T17:10:54.844 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-29T17:10:54.845 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-29T17:10:54.846 INFO:tasks.ceph.mds.a.smithi073.stderr:2023-07-29T17:10:54.830+0000 7fb737b37700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 110533) UID: 0 2023-07-29T17:10:54.846 INFO:tasks.ceph.mds.a.smithi073.stderr:2023-07-29T17:10:54.830+0000 7fb737b37700 -1 mds.a *** got signal Terminated *** 2023-07-29T17:10:54.846 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-07-29T17:10:54.830+0000 7fbb80d16700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 109745) UID: 0 2023-07-29T17:10:54.846 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-07-29T17:10:54.830+0000 7fbb80d16700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-29T17:10:54.847 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:10:54.830+0000 7f524acab700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 110379) UID: 0 2023-07-29T17:10:54.847 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:10:54.830+0000 7f524acab700 -1 osd.2 29 *** Got signal Terminated *** 2023-07-29T17:10:54.847 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-07-29T17:10:54.830+0000 7f524acab700 -1 osd.2 29 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-29T17:10:54.847 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:10:54.828+0000 7f3543c9b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 110188) UID: 0 2023-07-29T17:10:54.848 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:10:54.828+0000 7f3543c9b700 -1 osd.0 29 *** Got signal Terminated *** 2023-07-29T17:10:54.848 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-07-29T17:10:54.828+0000 7f3543c9b700 -1 osd.0 29 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-29T17:10:54.848 INFO:tasks.ceph.mon.b.smithi073.stderr:2023-07-29T17:10:54.830+0000 7f83984cf700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 109750) UID: 0 2023-07-29T17:10:54.848 INFO:tasks.ceph.mon.b.smithi073.stderr:2023-07-29T17:10:54.830+0000 7f83984cf700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-29T17:10:54.848 INFO:tasks.ceph.mon.c.smithi073.stderr:2023-07-29T17:10:54.831+0000 7f6a39f70700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 109755) UID: 0 2023-07-29T17:10:54.849 INFO:tasks.ceph.mon.c.smithi073.stderr:2023-07-29T17:10:54.831+0000 7f6a39f70700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-29T17:10:54.886 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:10:54.872+0000 7fb4d777b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 109764) UID: 0 2023-07-29T17:10:54.887 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-07-29T17:10:54.872+0000 7fb4d777b700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-29T17:10:55.046 INFO:tasks.ceph.mgr.x.smithi073.stderr:daemon-helper: command crashed with signal 15 2023-07-29T17:10:55.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T17:12:55.262 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-07-29T17:12:55.263 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T17:12:55.264 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-29T17:12:55.273 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T17:12:55.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T17:14:55.314 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-07-29T17:14:55.315 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-07-29T17:14:55.316 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-29T17:14:55.317 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-29T17:14:55.317 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.318 INFO:tasks.ceph.mds.a:Stopped 2023-07-29T17:14:55.318 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-29T17:14:55.319 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-29T17:14:55.319 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.320 INFO:tasks.ceph.osd.0:Stopped 2023-07-29T17:14:55.320 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-29T17:14:55.321 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-29T17:14:55.322 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2023-07-29T17:14:55.322 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-29T17:14:55.323 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.323 INFO:tasks.ceph.osd.2:Stopped 2023-07-29T17:14:55.324 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-29T17:14:55.324 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-29T17:14:55.325 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:55.326 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1465, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1178, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-07-29T17:14:55.327 INFO:tasks.ceph.mgr.x:Stopped 2023-07-29T17:14:55.328 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-29T17:14:55.328 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.329 INFO:tasks.ceph.mgr.y:Stopped 2023-07-29T17:14:55.329 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-29T17:14:55.330 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-29T17:14:55.330 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.331 INFO:tasks.ceph.mon.a:Stopped 2023-07-29T17:14:55.332 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-29T17:14:55.332 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.333 INFO:tasks.ceph.mon.b:Stopped 2023-07-29T17:14:55.333 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-29T17:14:55.334 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T17:14:55.335 INFO:tasks.ceph.mon.c:Stopped 2023-07-29T17:14:55.335 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-29T17:14:55.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-07-29T17:14:55.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-29T17:14:55.375 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-29T17:14:55.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:14:55.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T17:14:55.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T17:14:55.784 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-29T17:14:56.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T17:14:56.081 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-29T17:14:56.260 INFO:teuthology.orchestra.run.smithi093.stderr:umount: /var/lib/ceph/osd/ceph-1: not mounted. 2023-07-29T17:14:56.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T17:14:56.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-07-29T17:14:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-07-29T17:14:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-07-29T17:14:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 579864 16806 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 19983 18301 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 3w CHR 1,11 0t0 3089 /dev/kmsg 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 4u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 5u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 7u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 8u netlink 0t0 20489 KOBJECT_UEVENT 2023-07-29T17:14:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 9u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 10r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 11u netlink 0t0 20495 AUDIT 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 12r REG 0,5 0 294 /proc/1/mountinfo 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 13r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 15u unix 0xffff93a297397980 0t0 20490 /run/systemd/private type=STREAM 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 16r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 17u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 22u unix 0xffff93a2965a6300 0t0 38354 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 23u unix 0xffff93a297395a00 0t0 20513 /run/udev/control type=SEQPACKET 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 24u unix 0xffff93a297394380 0t0 296 /run/systemd/notify type=DGRAM 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 25u unix 0xffff93a297390900 0t0 298 /run/systemd/cgroups-agent type=DGRAM 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 26u unix 0xffff93a297390d80 0t0 300 type=DGRAM 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 27u unix 0xffff93a297393600 0t0 301 type=DGRAM 2023-07-29T17:14:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 28u unix 0xffff93a297391b00 0t0 314 /run/systemd/journal/dev-log type=DGRAM 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 29u netlink 0t0 20518 KOBJECT_UEVENT 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 30r CHR 10,235 0t0 3187 /dev/autofs 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 31r FIFO 0,13 0t0 20523 pipe 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 32u unix 0xffff93a297391f80 0t0 20525 /run/systemd/coredump type=SEQPACKET 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 33u unix 0xffff93a297395e80 0t0 319 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 34u unix 0xffff93a297394800 0t0 322 /run/systemd/journal/socket type=DGRAM 2023-07-29T17:14:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 35u FIFO 0,24 0t0 20527 /run/dmeventd-server 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 36u FIFO 0,24 0t0 20528 /run/dmeventd-client 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 37u unix 0xffff93a297390000 0t0 20529 /run/lvm/lvmpolld.socket type=STREAM 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 38u unix 0xffff93a297395100 0t0 20533 /run/rpcbind.sock type=STREAM 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 39u IPv4 20536 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 40u IPv4 20537 0t0 UDP *:sunrpc 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 41u IPv6 20538 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 42u IPv6 20539 0t0 UDP *:sunrpc 2023-07-29T17:14:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 43u FIFO 0,24 0t0 20540 /run/initctl 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 44r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 45u unix 0xffff939ff8eade80 0t0 6475 type=DGRAM 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 46u unix 0xffff93a295926780 0t0 3971 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 47u unix 0xffff93a295927980 0t0 20613 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 48u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 49u unix 0xffff939ff8ead100 0t0 6830 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 50u unix 0xffff939ff8eacc80 0t0 6834 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 51u unix 0xffff939ff8ead580 0t0 6857 type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 52u unix 0xffff93a2965a1200 0t0 26829 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 53u unix 0xffff93a2965a3a80 0t0 26831 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 54u netlink 0t0 6502 SELINUX 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 55u unix 0xffff93a2965a2400 0t0 21073 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 57u unix 0xffff93a297391680 0t0 28047 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 58u unix 0xffff93a294f51b00 0t0 26839 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 59u unix 0xffff93a2963f6780 0t0 26841 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 61u unix 0xffff93a294f50900 0t0 23310 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 62u unix 0xffff93a2963f6c00 0t0 28056 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 63u unix 0xffff93a2963f4c80 0t0 26843 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 64u unix 0xffff93a297392400 0t0 28058 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 66u unix 0xffff93a2965a7080 0t0 20998 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 67u unix 0xffff93a297393f00 0t0 26849 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 70u unix 0xffff93a294f55100 0t0 23521 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-07-29T17:14:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 9 root txt unknown /proc/9/exe 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 13 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 13 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 13 root txt unknown /proc/13/exe 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_sched 14 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_sched 14 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_sched 14 root txt unknown /proc/14/exe 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:migration 15 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:migration 15 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:migration 15 root txt unknown /proc/15/exe 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 16 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 16 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 16 root txt unknown /proc/16/exe 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 17 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 17 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 17 root txt unknown /proc/17/exe 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 18 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 18 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 18 root txt unknown /proc/18/exe 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 19 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 19 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 19 root txt unknown /proc/19/exe 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:migration 20 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:migration 20 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:migration 20 root txt unknown /proc/20/exe 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 21 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 21 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 21 root txt unknown /proc/21/exe 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 23 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 23 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 23 root txt unknown /proc/23/exe 2023-07-29T17:14:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 24 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 24 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 24 root txt unknown /proc/24/exe 2023-07-29T17:14:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 25 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 25 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 25 root txt unknown /proc/25/exe 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:migration 26 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:migration 26 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:migration 26 root txt unknown /proc/26/exe 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 27 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 27 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 27 root txt unknown /proc/27/exe 2023-07-29T17:14:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 29 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 29 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 29 root txt unknown /proc/29/exe 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 30 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 30 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 30 root txt unknown /proc/30/exe 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 31 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 31 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 31 root txt unknown /proc/31/exe 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:migration 32 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:migration 32 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:migration 32 root txt unknown /proc/32/exe 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 33 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 33 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 33 root txt unknown /proc/33/exe 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 35 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 35 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 35 root txt unknown /proc/35/exe 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 36 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 36 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 36 root txt unknown /proc/36/exe 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 37 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 37 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 37 root txt unknown /proc/37/exe 2023-07-29T17:14:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:migration 38 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:migration 38 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:migration 38 root txt unknown /proc/38/exe 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 39 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 39 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 39 root txt unknown /proc/39/exe 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 41 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 41 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 41 root txt unknown /proc/41/exe 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 42 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 42 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 42 root txt unknown /proc/42/exe 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 43 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 43 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 43 root txt unknown /proc/43/exe 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:migration 44 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:migration 44 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:migration 44 root txt unknown /proc/44/exe 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 45 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 45 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 45 root txt unknown /proc/45/exe 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 47 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 47 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 47 root txt unknown /proc/47/exe 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 48 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 48 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 48 root txt unknown /proc/48/exe 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 49 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 49 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 49 root txt unknown /proc/49/exe 2023-07-29T17:14:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:migration 50 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:migration 50 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:migration 50 root txt unknown /proc/50/exe 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 51 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 51 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 51 root txt unknown /proc/51/exe 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 53 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 53 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 53 root txt unknown /proc/53/exe 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 54 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 54 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 54 root txt unknown /proc/54/exe 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 55 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 55 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:watchdog/ 55 root txt unknown /proc/55/exe 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:migration 56 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:migration 56 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:migration 56 root txt unknown /proc/56/exe 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 57 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 57 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 57 root txt unknown /proc/57/exe 2023-07-29T17:14:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 59 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 59 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 59 root txt unknown /proc/59/exe 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 68 root cwd DIR 0,6 3300 3 / 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 68 root rtd DIR 0,6 3300 3 / 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 68 root txt unknown /proc/68/exe 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:netns 69 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:netns 69 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:netns 69 root txt unknown /proc/69/exe 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 70 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 70 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 70 root txt unknown /proc/70/exe 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 71 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 71 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 71 root txt unknown /proc/71/exe 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 72 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 72 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 72 root txt unknown /proc/72/exe 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 73 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 73 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 73 root txt unknown /proc/73/exe 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 74 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 74 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 74 root txt unknown /proc/74/exe 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 75 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 75 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 75 root txt unknown /proc/75/exe 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 76 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 76 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 76 root txt unknown /proc/76/exe 2023-07-29T17:14:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 77 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 77 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 77 root txt unknown /proc/77/exe 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:crypto 78 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:crypto 78 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:crypto 78 root txt unknown /proc/78/exe 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 79 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 79 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 79 root txt unknown /proc/79/exe 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 80 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 80 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 80 root txt unknown /proc/80/exe 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 81 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 81 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 81 root txt unknown /proc/81/exe 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 82 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 82 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 82 root txt unknown /proc/82/exe 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 83 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 83 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 83 root txt unknown /proc/83/exe 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 84 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 84 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 84 root txt unknown /proc/84/exe 2023-07-29T17:14:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 85 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 85 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 85 root txt unknown /proc/85/exe 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 86 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 86 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 86 root txt unknown /proc/86/exe 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 87 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 87 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 87 root txt unknown /proc/87/exe 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 88 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 88 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 88 root txt unknown /proc/88/exe 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:md 89 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:md 89 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:md 89 root txt unknown /proc/89/exe 2023-07-29T17:14:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 90 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 90 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 90 root txt unknown /proc/90/exe 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 91 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 91 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 91 root txt unknown /proc/91/exe 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 92 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 92 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 92 root txt unknown /proc/92/exe 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 109 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 109 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 109 root txt unknown /proc/109/exe 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 169 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 169 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 169 root txt unknown /proc/169/exe 2023-07-29T17:14:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 170 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 170 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 170 root txt unknown /proc/170/exe 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 171 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 171 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 171 root txt unknown /proc/171/exe 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 172 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 172 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 172 root txt unknown /proc/172/exe 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 173 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 173 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 173 root txt unknown /proc/173/exe 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 174 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 174 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 174 root txt unknown /proc/174/exe 2023-07-29T17:14:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 175 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 175 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 175 root txt unknown /proc/175/exe 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 176 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 176 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 176 root txt unknown /proc/176/exe 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 177 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 177 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 177 root txt unknown /proc/177/exe 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 178 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 178 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 178 root txt unknown /proc/178/exe 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 217 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 217 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 217 root txt unknown /proc/217/exe 2023-07-29T17:14:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 230 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 230 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 230 root txt unknown /proc/230/exe 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 232 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 232 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 232 root txt unknown /proc/232/exe 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 238 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 238 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 238 root txt unknown /proc/238/exe 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 266 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 266 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 266 root txt unknown /proc/266/exe 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 268 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 268 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 268 root txt unknown /proc/268/exe 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 270 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 270 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 270 root txt unknown /proc/270/exe 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 274 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 274 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 274 root txt unknown /proc/274/exe 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 275 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 275 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 275 root txt unknown /proc/275/exe 2023-07-29T17:14:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 277 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 277 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 277 root txt unknown /proc/277/exe 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 373 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 373 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 373 root txt unknown /proc/373/exe 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 378 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 378 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 378 root txt unknown /proc/378/exe 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 408 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 408 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 408 root txt unknown /proc/408/exe 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 409 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 409 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 409 root txt unknown /proc/409/exe 2023-07-29T17:14:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 410 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 410 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 410 root txt unknown /proc/410/exe 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 411 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 411 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 411 root txt unknown /proc/411/exe 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 412 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 412 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 412 root txt unknown /proc/412/exe 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 422 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 422 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 422 root txt unknown /proc/422/exe 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 428 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 428 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 428 root txt unknown /proc/428/exe 2023-07-29T17:14:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 429 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 429 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 429 root txt unknown /proc/429/exe 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 430 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 430 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 430 root txt unknown /proc/430/exe 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 431 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 431 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 431 root txt unknown /proc/431/exe 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 432 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 432 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 432 root txt unknown /proc/432/exe 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 433 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 433 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 433 root txt unknown /proc/433/exe 2023-07-29T17:14:56.444 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 434 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 434 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 434 root txt unknown /proc/434/exe 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 435 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 435 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 435 root txt unknown /proc/435/exe 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 436 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 436 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 436 root txt unknown /proc/436/exe 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 437 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 437 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 437 root txt unknown /proc/437/exe 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 438 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 438 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 438 root txt unknown /proc/438/exe 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 439 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 439 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 439 root txt unknown /proc/439/exe 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 440 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 440 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 440 root txt unknown /proc/440/exe 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 441 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 441 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 441 root txt unknown /proc/441/exe 2023-07-29T17:14:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 442 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 442 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 442 root txt unknown /proc/442/exe 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 443 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 443 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 443 root txt unknown /proc/443/exe 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 444 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 444 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 444 root txt unknown /proc/444/exe 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 445 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 445 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 445 root txt unknown /proc/445/exe 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 446 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 446 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 446 root txt unknown /proc/446/exe 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 447 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 447 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 447 root txt unknown /proc/447/exe 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 448 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 448 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 448 root txt unknown /proc/448/exe 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 449 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 449 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 449 root txt unknown /proc/449/exe 2023-07-29T17:14:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 450 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 450 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 450 root txt unknown /proc/450/exe 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 451 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 451 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 451 root txt unknown /proc/451/exe 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 460 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 460 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 460 root txt unknown /proc/460/exe 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 475 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 475 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 475 root txt unknown /proc/475/exe 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 478 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 478 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 478 root txt unknown /proc/478/exe 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 479 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 479 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 479 root txt unknown /proc/479/exe 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 553 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 553 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 553 root txt unknown /proc/553/exe 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root txt REG 8,1 158104 35692 /usr/lib/systemd/systemd-journald 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root mem REG 0,24 8 3320 /run/systemd/journal/kernel-seqnum 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 2w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 3u unix 0xffff93a297395e80 0t0 319 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 4u unix 0xffff93a297394800 0t0 322 /run/systemd/journal/socket type=DGRAM 2023-07-29T17:14:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 5u unix 0xffff93a297391b00 0t0 314 /run/systemd/journal/dev-log type=DGRAM 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 6u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 7u CHR 1,11 0t0 3089 /dev/kmsg 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 8r REG 0,5 0 3321 /proc/sys/kernel/hostname 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 9u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 10u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 11u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 12u unix 0xffff93a2965a1680 0t0 16065 type=DGRAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 13u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 14u REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 15u unix 0xffff93a295926780 0t0 3971 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 16u unix 0xffff93a2965a1200 0t0 26829 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 17u unix 0xffff93a295927980 0t0 20613 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 18u unix 0xffff93a2965a3a80 0t0 26831 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 19u unix 0xffff93a2965a6300 0t0 38354 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 20u unix 0xffff93a297391680 0t0 28047 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 21u unix 0xffff93a2963f6c00 0t0 28056 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 22u unix 0xffff93a294f51b00 0t0 26839 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 23u unix 0xffff93a2963f6780 0t0 26841 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 25u unix 0xffff93a294f50900 0t0 23310 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 26u unix 0xffff93a2963f4c80 0t0 26843 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 27u unix 0xffff93a297392400 0t0 28058 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 28u unix 0xffff93a2965a2400 0t0 21073 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 29u unix 0xffff93a2965a7080 0t0 20998 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 30u unix 0xffff93a297393f00 0t0 26849 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 580 root 32u unix 0xffff93a294f55100 0t0 23521 /run/systemd/journal/stdout type=STREAM 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 590 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 590 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 590 root txt unknown /proc/590/exe 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 615 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 615 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 615 root txt unknown /proc/615/exe 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root txt REG 8,1 418336 35749 /usr/lib/systemd/systemd-udevd 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 594085 395724 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.symbols.bin 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 894063 395721 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.alias.bin 2023-07-29T17:14:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 11120017 61455 /etc/udev/hwdb.bin 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-07-29T17:14:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 10158 395725 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.builtin.bin 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 461225 395729 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.dep.bin 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 579864 16806 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root mem REG 8,1 19983 18301 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 1u unix 0xffff93a295923600 0t0 3823 type=STREAM 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 2u unix 0xffff93a295923600 0t0 3823 type=STREAM 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 3u unix 0xffff93a297395a00 0t0 20513 /run/udev/control type=SEQPACKET 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 4u netlink 0t0 20518 KOBJECT_UEVENT 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 5u unix 0xffff93a295922400 0t0 3830 type=DGRAM 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 6r REG 8,1 11120017 61455 /etc/udev/hwdb.bin 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 7u unix 0xffff93a295921b00 0t0 3836 type=DGRAM 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 8u unix 0xffff93a295925e80 0t0 3837 type=DGRAM 2023-07-29T17:14:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 9r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 10u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 11u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 12u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 619 root 13u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 650 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 650 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 650 root txt unknown /proc/650/exe 2023-07-29T17:14:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 664 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 664 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 664 root txt unknown /proc/664/exe 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 673 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 673 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 673 root txt unknown /proc/673/exe 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 674 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 674 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 674 root txt unknown /proc/674/exe 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 675 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 675 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 675 root txt unknown /proc/675/exe 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 676 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 676 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 676 root txt unknown /proc/676/exe 2023-07-29T17:14:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 677 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 677 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 677 root txt unknown /proc/677/exe 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 703 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 703 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 703 root txt unknown /proc/703/exe 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc txt REG 8,1 63024 31898 /usr/bin/rpcbind 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 1u unix 0xffff93a295927080 0t0 3970 type=STREAM 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 2u unix 0xffff93a295927080 0t0 3970 type=STREAM 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 3u unix 0xffff93a297395100 0t0 20533 /run/rpcbind.sock type=STREAM 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 4u IPv4 20536 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 5u IPv4 20537 0t0 UDP *:sunrpc 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 6u IPv6 20538 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 7u IPv6 20539 0t0 UDP *:sunrpc 2023-07-29T17:14:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 722 rpc 8rW REG 0,24 0 4007 /run/rpcbind/rpcbind.lock 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 731 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 731 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 731 root txt unknown /proc/731/exe 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 3u netlink 0t0 22460 AUDIT 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 5w REG 8,1 5352447 61461 /var/log/audit/audit.log 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 6u unix 0xffff93a2965a3600 0t0 22464 type=DGRAM 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 7u unix 0xffff93a2965a7980 0t0 22463 type=STREAM 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 8u unix 0xffff93a2965a0d80 0t0 22465 type=STREAM 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 9u unix 0xffff93a2965a5100 0t0 22466 type=STREAM 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 root 10u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 3u netlink 0t0 22460 AUDIT 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 5w REG 8,1 5352447 61461 /var/log/audit/audit.log 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 6u unix 0xffff93a2965a3600 0t0 22464 type=DGRAM 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 7u unix 0xffff93a2965a7980 0t0 22463 type=STREAM 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 8u unix 0xffff93a2965a0d80 0t0 22465 type=STREAM 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 9u unix 0xffff93a2965a5100 0t0 22466 type=STREAM 2023-07-29T17:14:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 737 auditd root 10u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 3u netlink 0t0 22460 AUDIT 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 5w REG 8,1 5352447 61461 /var/log/audit/audit.log 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 6u unix 0xffff93a2965a3600 0t0 22464 type=DGRAM 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 7u unix 0xffff93a2965a7980 0t0 22463 type=STREAM 2023-07-29T17:14:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 8u unix 0xffff93a2965a0d80 0t0 22465 type=STREAM 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 9u unix 0xffff93a2965a5100 0t0 22466 type=STREAM 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 736 739 auditd root 10u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root txt REG 8,1 21008 29668 /usr/sbin/sedispatch 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root 0u unix 0xffff93a2965a0900 0t0 22462 type=STREAM 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root 3u unix 0xffff939fc6b4a400 0t0 32598 type=STREAM 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 738 root 4u unix 0xffff939ff8eaad00 0t0 33560 type=DGRAM 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 742 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 742 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 742 root txt unknown /proc/742/exe 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 743 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 743 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 743 root txt unknown /proc/743/exe 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 763 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 763 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 763 root txt unknown /proc/763/exe 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 764 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 764 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 764 root txt unknown /proc/764/exe 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 765 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 765 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 765 root txt unknown /proc/765/exe 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 766 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 766 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 766 root txt unknown /proc/766/exe 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 767 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 767 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 767 root txt unknown /proc/767/exe 2023-07-29T17:14:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 768 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 768 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 768 root txt unknown /proc/768/exe 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-gc/dm 769 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-gc/dm 769 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-gc/dm 769 root txt unknown /proc/769/exe 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 770 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 770 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 770 root txt unknown /proc/770/exe 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 771 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 771 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 771 root txt unknown /proc/771/exe 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt txt REG 8,1 25472 28704 /usr/bin/lsmd 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt mem REG 8,1 55104 25835 /usr/lib64/libconfig.so.9.2.0 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 1u unix 0xffff93a2965a2d00 0t0 27667 type=STREAM 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 2u unix 0xffff93a2965a3f00 0t0 27668 type=STREAM 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 3uW REG 0,24 0 27724 /run/lsm/ipc/.lsmd-ipc-lock 2023-07-29T17:14:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 5u unix 0xffff93a2965a4800 0t0 27923 /var/run/lsm/ipc/simc type=STREAM 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 794 libstoragemgmt 6u unix 0xffff939ff8eaba80 0t0 6922 /var/run/lsm/ipc/sim type=STREAM 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 889 gmain polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 891 gdbus polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 901 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 902 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 903 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 904 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 905 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 906 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 907 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 908 JS\x20Hel polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 3r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 5u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 6u unix 0xffff93a297394c80 0t0 21112 type=STREAM 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 8r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 9u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 797 913 polkitd polkitd 10u unix 0xffff93a297390480 0t0 21393 type=DGRAM 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root txt REG 8,1 63720 29129 /usr/sbin/irqbalance 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 255032 24666 /usr/lib64/libncursesw.so.6.1 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 1u unix 0xffff93a294f52400 0t0 20392 type=STREAM 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 2u unix 0xffff93a294f52400 0t0 20392 type=STREAM 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 root 5u unix 0xffff93a2965a2880 0t0 27848 /run/irqbalance/irqbalance798.sock type=STREAM 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root txt REG 8,1 63720 29129 /usr/sbin/irqbalance 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-07-29T17:14:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 255032 24666 /usr/lib64/libncursesw.so.6.1 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 1u unix 0xffff93a294f52400 0t0 20392 type=STREAM 2023-07-29T17:14:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 2u unix 0xffff93a294f52400 0t0 20392 type=STREAM 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 798 818 gmain root 5u unix 0xffff93a2965a2880 0t0 27848 /run/irqbalance/irqbalance798.sock type=STREAM 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus txt REG 8,1 245552 26906 /usr/bin/dbus-daemon 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 1u unix 0xffff93a2963f6300 0t0 23306 type=STREAM 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 2u unix 0xffff93a2963f6300 0t0 23306 type=STREAM 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 3u unix 0xffff939ff8ead100 0t0 6830 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 4u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 5u sock 0,9 0t0 6947 protocol: NETLINK 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 6u netlink 0t0 6948 SELINUX 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 7r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 8u unix 0xffff939ff8eabf00 0t0 6953 type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 9u unix 0xffff939ff8ea9200 0t0 6954 type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 10u unix 0xffff939ff8eaa400 0t0 6955 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 11u unix 0xffff93a2963f3180 0t0 6956 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 12u unix 0xffff93a297392d00 0t0 6959 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 13u unix 0xffff93a2965a4380 0t0 6960 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 14u unix 0xffff939fc6b49b00 0t0 34075 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 15u unix 0xffff93a297343600 0t0 27029 type=DGRAM 2023-07-29T17:14:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 17u unix 0xffff93a2963f0000 0t0 21394 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 18u unix 0xffff93a0128f0d80 0t0 40194 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 dbus 19u unix 0xffff939fc6b4c380 0t0 28162 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus txt REG 8,1 245552 26906 /usr/bin/dbus-daemon 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 1u unix 0xffff93a2963f6300 0t0 23306 type=STREAM 2023-07-29T17:14:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 2u unix 0xffff93a2963f6300 0t0 23306 type=STREAM 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 3u unix 0xffff939ff8ead100 0t0 6830 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 4u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 5u sock 0,9 0t0 6947 protocol: NETLINK 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 6u netlink 0t0 6948 SELINUX 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 7r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 8u unix 0xffff939ff8eabf00 0t0 6953 type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 9u unix 0xffff939ff8ea9200 0t0 6954 type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 10u unix 0xffff939ff8eaa400 0t0 6955 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 11u unix 0xffff93a2963f3180 0t0 6956 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 12u unix 0xffff93a297392d00 0t0 6959 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 13u unix 0xffff93a2965a4380 0t0 6960 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 14u unix 0xffff939fc6b49b00 0t0 34075 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 15u unix 0xffff93a297343600 0t0 27029 type=DGRAM 2023-07-29T17:14:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 17u unix 0xffff93a2963f0000 0t0 21394 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 18u unix 0xffff93a0128f0d80 0t0 40194 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-daem 799 885 dbus-daem dbus 19u unix 0xffff939fc6b4c380 0t0 28162 /run/dbus/system_bus_socket type=STREAM 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T17:14:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-07-29T17:14:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T17:14:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 1u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 2u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 5u unix 0xffff93a2965a6c00 0t0 27979 type=DGRAM 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 6u unix 0xffff93a2965a7500 0t0 27980 type=STREAM 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 8r REG 0,4 0 4026532000 net 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 9r REG 0,4 0 4026532493 mnt 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 10u netlink 0t0 28052 KOBJECT_UEVENT 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 11u netlink 0t0 28053 GENERIC 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 12u netlink 0t0 28054 GENERIC 2023-07-29T17:14:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 13u netlink 0t0 28055 ROUTE 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 14r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 15r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 17u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 18u unix 0xffff93a2963f1f80 0t0 23516 type=STREAM 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 19w FIFO 0,24 0t0 27139 /run/systemd/inhibit/1.ref 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 20u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 21u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 22u pack 7027 0t0 IP type=SOCK_DGRAM 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 23u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 24u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 25u pack 7135 0t0 ARP type=SOCK_DGRAM 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 root 26u IPv4 7136 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T17:14:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-07-29T17:14:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-07-29T17:14:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T17:14:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-07-29T17:14:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-07-29T17:14:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 1u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 2u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 5u unix 0xffff93a2965a6c00 0t0 27979 type=DGRAM 2023-07-29T17:14:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 6u unix 0xffff93a2965a7500 0t0 27980 type=STREAM 2023-07-29T17:14:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 8r REG 0,4 0 4026532000 net 2023-07-29T17:14:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 9r REG 0,4 0 4026532493 mnt 2023-07-29T17:14:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 10u netlink 0t0 28052 KOBJECT_UEVENT 2023-07-29T17:14:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 11u netlink 0t0 28053 GENERIC 2023-07-29T17:14:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 12u netlink 0t0 28054 GENERIC 2023-07-29T17:14:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 13u netlink 0t0 28055 ROUTE 2023-07-29T17:14:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 14r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 15r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T17:14:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 17u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 18u unix 0xffff93a2963f1f80 0t0 23516 type=STREAM 2023-07-29T17:14:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 19w FIFO 0,24 0t0 27139 /run/systemd/inhibit/1.ref 2023-07-29T17:14:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 20u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 21u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 22u pack 7027 0t0 IP type=SOCK_DGRAM 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 23u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 24u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 25u pack 7135 0t0 ARP type=SOCK_DGRAM 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 890 gmain root 26u IPv4 7136 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T17:14:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T17:14:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-07-29T17:14:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-07-29T17:14:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 1u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 2u unix 0xffff93a294f50d80 0t0 20458 type=STREAM 2023-07-29T17:14:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 5u unix 0xffff93a2965a6c00 0t0 27979 type=DGRAM 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 6u unix 0xffff93a2965a7500 0t0 27980 type=STREAM 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 7u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 8r REG 0,4 0 4026532000 net 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 9r REG 0,4 0 4026532493 mnt 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 10u netlink 0t0 28052 KOBJECT_UEVENT 2023-07-29T17:14:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 11u netlink 0t0 28053 GENERIC 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 12u netlink 0t0 28054 GENERIC 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 13u netlink 0t0 28055 ROUTE 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 14r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 15r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 17u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 18u unix 0xffff93a2963f1f80 0t0 23516 type=STREAM 2023-07-29T17:14:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 19w FIFO 0,24 0t0 27139 /run/systemd/inhibit/1.ref 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 20u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 21u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 22u pack 7027 0t0 IP type=SOCK_DGRAM 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 23u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 24u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 25u pack 7135 0t0 ARP type=SOCK_DGRAM 2023-07-29T17:14:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 801 892 gdbus root 26u IPv4 7136 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root txt REG 8,1 267568 35693 /usr/lib/systemd/systemd-logind 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 579864 16806 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root mem REG 8,1 19983 18301 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T17:14:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 1u unix 0xffff93a2963f5e80 0t0 23372 type=STREAM 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 2u unix 0xffff93a2963f5e80 0t0 23372 type=STREAM 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 3u unix 0xffff93a2963f5100 0t0 23378 type=DGRAM 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 4u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 5u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 6u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 7r REG 0,21 4096 22520 /sys/devices/virtual/tty/tty0/active 2023-07-29T17:14:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 8u netlink 0t0 23384 KOBJECT_UEVENT 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 9r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 10r FIFO 0,24 0t0 27139 /run/systemd/inhibit/1.ref 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 11u netlink 0t0 23385 KOBJECT_UEVENT 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 12u netlink 0t0 23386 KOBJECT_UEVENT 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 13u netlink 0t0 23387 KOBJECT_UEVENT 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 14u unix 0xffff93a2963f4380 0t0 23388 type=STREAM 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 15u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 16u CHR 13,65 0t0 3279 /dev/input/event1 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 17u CHR 13,64 0t0 3278 /dev/input/event0 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 18u CHR 13,66 0t0 6209 /dev/input/event2 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 19u CHR 4,6 0t0 3102 /dev/tty6 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 804 root 20r FIFO 0,24 0t0 36825 /run/systemd/sessions/1.ref 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root txt REG 8,1 734288 30409 /usr/sbin/smartd 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 805 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph 1u unix 0xffff93a2965a6780 0t0 27836 type=STREAM 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 807 ceph 2u unix 0xffff93a2965a6780 0t0 27836 type=STREAM 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root txt REG 8,1 185824 30313 /usr/sbin/mcelog 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root 1u unix 0xffff93a297393a80 0t0 21055 type=STREAM 2023-07-29T17:14:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root 2u unix 0xffff93a297393a80 0t0 21055 type=STREAM 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root 3r CHR 10,227 0t0 3281 /dev/mcelog 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 808 root 4u unix 0xffff93a297391200 0t0 21058 /var/run/mcelog-client type=STREAM 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root txt REG 8,1 1150560 21617 /usr/bin/bash 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root 1u unix 0xffff93a2965a1b00 0t0 27919 type=STREAM 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ksmtuned 826 root 2u unix 0xffff93a2965a1b00 0t0 27919 type=STREAM 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony txt REG 8,1 359680 30310 /usr/sbin/chronyd 2023-07-29T17:14:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 720816 26783 /usr/lib64/libnss_myhostname.so.2 2023-07-29T17:14:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 29264 24705 /usr/lib64/libnss_dns-2.28.so 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 3u unix 0xffff93a297344380 0t0 26931 type=DGRAM 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 5u IPv4 26938 0t0 UDP localhost:323 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 6u IPv6 26939 0t0 UDP localhost:323 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 841 chrony 7u unix 0xffff93a297344c80 0t0 26941 /run/chrony/chronyd.sock type=DGRAM 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 0,14 15595 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T17:14:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T17:14:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 1u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 2u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 3w REG 8,1 35053 18929 /var/log/tuned/tuned.log 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 4u netlink 0t0 7026 KOBJECT_UEVENT 2023-07-29T17:14:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 5u unix 0xffff939fc6b4cc80 0t0 21497 type=STREAM 2023-07-29T17:14:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 7w CHR 10,62 0t0 3283 /dev/cpu_dma_latency 2023-07-29T17:14:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 8u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 9u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 10u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 11u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 12u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 13u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 14u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 15u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 16r FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 17w FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 18u unix 0xffff93a2965a5580 0t0 28524 type=STREAM 2023-07-29T17:14:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 root 19u unix 0xffff93a2965a3180 0t0 28525 type=STREAM 2023-07-29T17:14:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 0,14 15595 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T17:14:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T17:14:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 1u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 2u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 3w REG 8,1 35053 18929 /var/log/tuned/tuned.log 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 4u netlink 0t0 7026 KOBJECT_UEVENT 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 5u unix 0xffff939fc6b4cc80 0t0 21497 type=STREAM 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 7w CHR 10,62 0t0 3283 /dev/cpu_dma_latency 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 8u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 9u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 10u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 11u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 12u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 13u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 14u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 15u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 16r FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 17w FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 18u unix 0xffff93a2965a5580 0t0 28524 type=STREAM 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1179 tuned root 19u unix 0xffff93a2965a3180 0t0 28525 type=STREAM 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 0,14 15595 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T17:14:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-07-29T17:14:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 1u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 2u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 3w REG 8,1 35053 18929 /var/log/tuned/tuned.log 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 4u netlink 0t0 7026 KOBJECT_UEVENT 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 5u unix 0xffff939fc6b4cc80 0t0 21497 type=STREAM 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 7w CHR 10,62 0t0 3283 /dev/cpu_dma_latency 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 8u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 9u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 10u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 11u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 12u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 13u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 14u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 15u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 16r FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 17w FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 18u unix 0xffff93a2965a5580 0t0 28524 type=STREAM 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1187 tuned root 19u unix 0xffff93a2965a3180 0t0 28525 type=STREAM 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 0,14 15595 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T17:14:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T17:14:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 1u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 2u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 3w REG 8,1 35053 18929 /var/log/tuned/tuned.log 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 4u netlink 0t0 7026 KOBJECT_UEVENT 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 5u unix 0xffff939fc6b4cc80 0t0 21497 type=STREAM 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 7w CHR 10,62 0t0 3283 /dev/cpu_dma_latency 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 8u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 9u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 10u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 11u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 12u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 13u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 14u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 15u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 16r FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 17w FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 18u unix 0xffff93a2965a5580 0t0 28524 type=STREAM 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1204 tuned root 19u unix 0xffff93a2965a3180 0t0 28525 type=STREAM 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-07-29T17:14:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 0,14 15595 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T17:14:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T17:14:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 1u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 2u unix 0xffff93a297397500 0t0 21180 type=STREAM 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 3w REG 8,1 35053 18929 /var/log/tuned/tuned.log 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 4u netlink 0t0 7026 KOBJECT_UEVENT 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 5u unix 0xffff939fc6b4cc80 0t0 21497 type=STREAM 2023-07-29T17:14:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 7w CHR 10,62 0t0 3283 /dev/cpu_dma_latency 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 8u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 9u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 10u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 11u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 12u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 13u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 14u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 15u a_inode 0,14 0 15595 [perf_event] 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 16r FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 17w FIFO 0,13 0t0 31748 pipe 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 18u unix 0xffff93a2965a5580 0t0 28524 type=STREAM 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 894 1205 tuned root 19u unix 0xffff93a2965a3180 0t0 28525 type=STREAM 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root 1u unix 0xffff93a2963f2880 0t0 23486 type=STREAM 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root 2u unix 0xffff93a2963f2880 0t0 23486 type=STREAM 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root 3u IPv4 23510 0t0 TCP *:ssh (LISTEN) 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 895 root 4u IPv6 23512 0t0 TCP *:ssh (LISTEN) 2023-07-29T17:14:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 914 gssproxy root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 915 gssproxy root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 916 gssproxy root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 917 gssproxy root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-07-29T17:14:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 1u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 2u unix 0xffff93a297396c00 0t0 21247 type=STREAM 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 3u unix 0xffff93a295995100 0t0 6079 type=DGRAM 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 4r FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 5u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 6u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 7u unix 0xffff93a295990d80 0t0 6082 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 8u unix 0xffff93a295991f80 0t0 6083 /run/gssproxy.sock type=STREAM 2023-07-29T17:14:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 911 918 gssproxy root 9w FIFO 0,13 0t0 6087 pipe 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root txt REG 8,1 75712 27715 /usr/sbin/crond 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 1u unix 0xffff93a294f54380 0t0 29853 type=STREAM 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 2u unix 0xffff93a294f54380 0t0 29853 type=STREAM 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 3uW REG 0,24 4 29865 /run/crond.pid 2023-07-29T17:14:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 4u unix 0xffff93a294f54c80 0t0 29866 type=DGRAM 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:crond 926 root 5r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root cwd DIR 8,1 4096 18406 /var/spool/at 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root txt REG 8,1 33408 28662 /usr/sbin/atd 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:atd 928 root 3uW REG 0,24 4 30771 /run/atd.pid 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe txt REG 8,1 82312 23646 /usr/sbin/nrpe 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 2w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 3u IPv4 27285 0t0 TCP *:nrpe (LISTEN) 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 4u unix 0xffff93a297341200 0t0 27276 type=DGRAM 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 1232 nrpe 5u IPv6 27286 0t0 TCP *:nrpe (LISTEN) 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 2w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-07-29T17:14:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 4u unix 0xffff939ff8ea8d80 0t0 32801 type=DGRAM 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 5w REG 8,1 730393 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 6r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 7w REG 8,1 107230 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 8w REG 8,1 1359445 18390 /var/log/messages 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 9w REG 8,1 687488 18391 /var/log/secure 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 10w REG 8,1 4417 18866 /var/log/cron 2023-07-29T17:14:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 root 11r REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-07-29T17:14:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 2w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 4u unix 0xffff939ff8ea8d80 0t0 32801 type=DGRAM 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 5w REG 8,1 730393 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 6r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 7w REG 8,1 107230 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 8w REG 8,1 1359445 18390 /var/log/messages 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 9w REG 8,1 687488 18391 /var/log/secure 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 10w REG 8,1 4417 18866 /var/log/cron 2023-07-29T17:14:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1248 in:imjour root 11r REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T17:14:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T17:14:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 1w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 2w CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 4u unix 0xffff939ff8ea8d80 0t0 32801 type=DGRAM 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 5w REG 8,1 730393 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 6r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 7w REG 8,1 107230 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 8w REG 8,1 1359445 18390 /var/log/messages 2023-07-29T17:14:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 9w REG 8,1 687488 18391 /var/log/secure 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 10w REG 8,1 4417 18866 /var/log/cron 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 1234 1253 rs:main root 11r REG 0,24 8388608 3343 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root txt REG 8,1 63944 20020 /usr/sbin/agetty 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root 0u CHR 4,65 0t0 3190 /dev/ttyS1 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root 1u CHR 4,65 0t0 3190 /dev/ttyS1 2023-07-29T17:14:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root 2u CHR 4,65 0t0 3190 /dev/ttyS1 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2027 root 4r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root txt REG 8,1 63944 20020 /usr/sbin/agetty 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root 0u CHR 4,1 0t0 3097 /dev/tty1 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root 1u CHR 4,1 0t0 3097 /dev/tty1 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root 2u CHR 4,1 0t0 3097 /dev/tty1 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 2028 root 4r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 2031 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 2031 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 2031 root txt unknown /proc/2031/exe 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root txt REG 8,1 38416 26752 /usr/bin/sleep 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root 1u unix 0xffff93a2965a1b00 0t0 27919 type=STREAM 2023-07-29T17:14:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:sleep 6094 root 2u unix 0xffff93a2965a1b00 0t0 27919 type=STREAM 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 20168 49090 /usr/lib64/security/pam_lastlog.so 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11760 47498 /usr/lib64/security/pam_umask.so 2023-07-29T17:14:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11824 47487 /usr/lib64/security/pam_motd.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-07-29T17:14:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11808 49096 /usr/lib64/security/pam_nologin.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 15920 47493 /usr/lib64/security/pam_sepermit.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-07-29T17:14:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-07-29T17:14:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-07-29T17:14:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-07-29T17:14:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-07-29T17:14:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 3u unix 0xffff939fc6b49f80 0t0 38391 type=DGRAM 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 4u IPv4 36784 0t0 TCP smithi093.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35376 (ESTABLISHED) 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 6u unix 0xffff93a294f56300 0t0 40186 type=STREAM 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 7w FIFO 0,24 0t0 36825 /run/systemd/sessions/1.ref 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6095 root 8u unix 0xffff939fc6b49200 0t0 38395 type=STREAM 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 1u unix 0xffff93a2965a4c80 0t0 34785 type=STREAM 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 2u unix 0xffff93a2965a4c80 0t0 34785 type=STREAM 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 3u unix 0xffff93a2965a5a00 0t0 34802 type=DGRAM 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 4u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 5u a_inode 0,14 0 15595 [signalfd] 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 6r DIR 0,26 0 788 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 7u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 8u netlink 0t0 34809 KOBJECT_UEVENT 2023-07-29T17:14:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 9u a_inode 0,14 0 15595 [eventpoll] 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 10r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 11u unix 0xffff93a0128f3600 0t0 44042 /run/user/1000/bus type=STREAM 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 12r REG 0,5 0 34798 /proc/6100/mountinfo 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 13r a_inode 0,14 0 15595 inotify 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 15u unix 0xffff93a2965a0000 0t0 34814 /run/user/1000/systemd/notify type=DGRAM 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 16u unix 0xffff93a2965a5e80 0t0 34816 type=DGRAM 2023-07-29T17:14:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 17u unix 0xffff93a2965a1f80 0t0 44033 type=DGRAM 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 18u unix 0xffff93a0128f4380 0t0 44034 /run/user/1000/systemd/private type=STREAM 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 19u unix 0xffff93a0128f0900 0t0 44036 type=STREAM 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 20u a_inode 0,14 0 15595 [timerfd] 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 6100 ubuntu 26u netlink 0t0 44045 SELINUX 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-07-29T17:14:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-07-29T17:14:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-07-29T17:14:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-07-29T17:14:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 579864 16806 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu mem REG 8,1 19983 18301 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 0r CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 1u unix 0xffff93a2965a4c80 0t0 34785 type=STREAM 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 2u unix 0xffff93a2965a4c80 0t0 34785 type=STREAM 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 3u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 4u a_inode 0,14 0 15595 [eventfd] 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 6w FIFO 0,13 0t0 34786 pipe 2023-07-29T17:14:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 6103 ubuntu 7u unix 0xffff93a2965a0480 0t0 34799 type=DGRAM 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 20168 49090 /usr/lib64/security/pam_lastlog.so 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11760 47498 /usr/lib64/security/pam_umask.so 2023-07-29T17:14:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11824 47487 /usr/lib64/security/pam_motd.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-07-29T17:14:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11808 49096 /usr/lib64/security/pam_nologin.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 15920 47493 /usr/lib64/security/pam_sepermit.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-07-29T17:14:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-07-29T17:14:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 0u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 1u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 2u CHR 1,3 0t0 3083 /dev/null 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 3u unix 0xffff939fc6b49f80 0t0 38391 type=DGRAM 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 4u IPv4 36784 0t0 TCP smithi093.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35376 (ESTABLISHED) 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 5u unix 0xffff939fc6b48000 0t0 38394 type=STREAM 2023-07-29T17:14:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 6u unix 0xffff93a294f56300 0t0 40186 type=STREAM 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 7w FIFO 0,24 0t0 36825 /run/systemd/sessions/1.ref 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 8r FIFO 0,13 0t0 43027 pipe 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 9w FIFO 0,13 0t0 43027 pipe 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 14r FIFO 0,13 0t0 38437 pipe 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 6115 ubuntu 16r FIFO 0,13 0t0 38438 pipe 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu cwd DIR 8,1 4096 17925 /home/ubuntu 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu txt REG 8,1 1150560 21617 /usr/bin/bash 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu 0r FIFO 0,13 0t0 38436 pipe 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu 1w FIFO 0,13 0t0 38437 pipe 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:bash 6163 ubuntu 2w FIFO 0,13 0t0 38438 pipe 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root txt REG 8,1 165576 29168 /usr/bin/sudo 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T17:14:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-07-29T17:14:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 33480 19143 /usr/lib64/libuuid.so.1.3.0 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 343680 19150 /usr/lib64/libblkid.so.1.1.0 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 371480 19824 /usr/lib64/libmount.so.1.1.0 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-07-29T17:14:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 433008 47807 /usr/libexec/sudo/sudoers.so 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T17:14:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 104576 47805 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T17:14:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 0r FIFO 0,13 0t0 38436 pipe 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 1w FIFO 0,13 0t0 38437 pipe 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 2w FIFO 0,13 0t0 38438 pipe 2023-07-29T17:14:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 3u netlink 0t0 36864 AUDIT 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 4u unix 0xffff93a2963f5580 0t0 45059 type=DGRAM 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 6r FIFO 0,13 0t0 45062 pipe 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 6185 root 7w FIFO 0,13 0t0 45062 pipe 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root txt REG 8,1 179608 30645 /usr/bin/lsof 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 0r FIFO 0,13 0t0 38436 pipe 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 1w FIFO 0,13 0t0 38437 pipe 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 2w FIFO 0,13 0t0 38438 pipe 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 3r DIR 0,5 0 1 /proc 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 4r DIR 0,5 0 40221 /proc/6187/fd 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 5w FIFO 0,13 0t0 40230 pipe 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6187 root 6r FIFO 0,13 0t0 40231 pipe 2023-07-29T17:14:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root rtd DIR 8,1 4096 2 / 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root txt REG 8,1 179608 30645 /usr/bin/lsof 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-07-29T17:14:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T17:14:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root 4r FIFO 0,13 0t0 40230 pipe 2023-07-29T17:14:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 6188 root 7w FIFO 0,13 0t0 40231 pipe 2023-07-29T17:14:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-07-29T17:14:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:root 2 0.0 0.0 0 0 ? S 17:11 0:00 [kthreadd] 2023-07-29T17:14:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:root 3 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [rcu_gp] 2023-07-29T17:14:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:root 4 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [rcu_par_gp] 2023-07-29T17:14:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:root 5 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [slub_flushwq] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 6 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/0:0-cgroup_pidlist_destroy] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 7 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/0:0H-events_highpri] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 8 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/0:1-events] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 9 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:0-events_unbound] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 10 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [mm_percpu_wq] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 11 0.0 0.0 0 0 ? S 17:11 0:00 \_ [rcu_tasks_rude_] 2023-07-29T17:14:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:root 12 0.0 0.0 0 0 ? S 17:11 0:00 \_ [rcu_tasks_trace] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 13 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/0] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 14 0.0 0.0 0 0 ? I 17:11 0:00 \_ [rcu_sched] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 15 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/0] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 16 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/0] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 17 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/0] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 18 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/1] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 19 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/1] 2023-07-29T17:14:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:root 20 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/1] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 21 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/1] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 22 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/1:0-events] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 23 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/1:0H-events_highpri] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 24 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/2] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 25 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/2] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 26 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/2] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 27 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/2] 2023-07-29T17:14:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:root 28 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/2:0-events] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 29 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/2:0H-events_highpri] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 30 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/3] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 31 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/3] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 32 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/3] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 33 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/3] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 34 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/3:0-cgroup_pidlist_destroy] 2023-07-29T17:14:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:root 35 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/3:0H-events_highpri] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 36 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/4] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 37 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/4] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 38 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/4] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 39 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/4] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 40 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/4:0-events] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 41 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/4:0H-events_highpri] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 42 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/5] 2023-07-29T17:14:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:root 43 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/5] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 44 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/5] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 45 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/5] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 46 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/5:0-cgroup_pidlist_destroy] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 47 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/5:0H-events_highpri] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 48 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/6] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 49 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/6] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 50 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/6] 2023-07-29T17:14:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:root 51 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/6] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 52 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/6:0-pm] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 53 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/6:0H-events_highpri] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 54 0.0 0.0 0 0 ? S 17:11 0:00 \_ [cpuhp/7] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 55 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdog/7] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 56 0.0 0.0 0 0 ? S 17:11 0:00 \_ [migration/7] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 57 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ksoftirqd/7] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 58 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/7:0-cgroup_pidlist_destroy] 2023-07-29T17:14:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:root 59 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/7:0H-events_highpri] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 61 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:1-writeback] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 62 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:2-events_unbound] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 63 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:3-events_unbound] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 64 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:4-events_unbound] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 65 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:5-events_unbound] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 66 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:6-events_unbound] 2023-07-29T17:14:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:root 67 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:7-flush-8:0] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 68 0.0 0.0 0 0 ? S 17:11 0:00 \_ [kdevtmpfs] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 69 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [netns] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 70 0.0 0.0 0 0 ? S 17:11 0:00 \_ [kauditd] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 71 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/1:1-cgroup_pidlist_destroy] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 72 0.0 0.0 0 0 ? S 17:11 0:00 \_ [khungtaskd] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 73 0.0 0.0 0 0 ? S 17:11 0:00 \_ [oom_reaper] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 74 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [writeback] 2023-07-29T17:14:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:root 75 0.0 0.0 0 0 ? S 17:11 0:00 \_ [kcompactd0] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 76 0.0 0.0 0 0 ? SN 17:11 0:00 \_ [ksmd] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 77 0.0 0.0 0 0 ? SN 17:11 0:00 \_ [khugepaged] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 78 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [crypto] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 79 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kintegrityd] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 80 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kblockd] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 81 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [blkcg_punt_bio] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 82 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/2:1-events] 2023-07-29T17:14:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:root 83 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/6:1-events] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 84 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/3:1-cgroup_pidlist_destroy] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 85 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/4:1-cgroup_destroy] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 86 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/5:1-cgroup_pidlist_destroy] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 87 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/7:1-mm_percpu_wq] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 88 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [tpm_dev_wq] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 89 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [md] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 90 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [edac-poller] 2023-07-29T17:14:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:root 91 0.0 0.0 0 0 ? S 17:11 0:00 \_ [watchdogd] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 92 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/1:1H-kblockd] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 109 0.0 0.0 0 0 ? S 17:11 0:00 \_ [kswapd0] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 169 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/3:2-cgroup_pidlist_destroy] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 170 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kthrotld] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 171 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [acpi_thermal_pm] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 172 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kmpath_rdacd] 2023-07-29T17:14:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:root 173 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kaluad] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 174 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/0:2-cgroup_pidlist_destroy] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 175 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/7:2-cgroup_pidlist_destroy] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 176 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [ipv6_addrconf] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 177 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kstrp] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 178 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/6:2-events] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 217 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [zswap-shrink] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 230 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/6:3-cgroup_pidlist_destroy] 2023-07-29T17:14:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:root 232 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/0:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 238 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/2:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 266 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/5:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 268 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/3:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 270 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/4:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 274 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/2:2-events] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 275 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/2:3-cgroup_pidlist_destroy] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 277 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/6:1H-kblockd] 2023-07-29T17:14:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:root 373 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/5:2-mm_percpu_wq] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 378 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kworker/7:1H-kblockd] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 408 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/7:3-events] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 409 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [nvme-wq] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 410 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [nvme-reset-wq] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 411 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [nvme-delete-wq] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 412 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [ata_sff] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 422 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [ixgbe] 2023-07-29T17:14:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:root 428 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_0] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 429 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_0] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 430 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_1] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 431 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_1] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 432 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_2] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 433 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_2] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 434 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_3] 2023-07-29T17:14:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:root 435 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_3] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 436 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_4] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 437 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_4] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 438 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_5] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 439 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_5] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 440 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_6] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 441 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_6] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 442 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_7] 2023-07-29T17:14:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:root 443 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_7] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 444 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_8] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 445 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_8] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 446 0.0 0.0 0 0 ? S 17:11 0:00 \_ [scsi_eh_9] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 447 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [scsi_tmf_9] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 448 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:8-flush-8:0] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 449 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:9-events_unbound] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 450 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:10-events_unbound] 2023-07-29T17:14:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:root 451 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/u16:11-events_unbound] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 460 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/1:2-cgroup_pidlist_destroy] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 475 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/4:2-events] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 478 0.0 0.0 0 0 ? S 17:11 0:00 \_ [jbd2/sda1-8] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 479 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [ext4-rsv-conver] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 553 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/0:3-events] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 590 0.0 0.0 0 0 ? S 17:11 0:00 \_ [ext4lazyinit] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 615 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/1:3-events] 2023-07-29T17:14:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:root 650 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/3:3-mm_percpu_wq] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 664 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [ipmi-msghandler] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 673 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kdmflush/253:0] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 674 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kdmflush/253:1] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 675 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kdmflush/253:2] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 676 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kdmflush/253:3] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 677 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [kdmflush/253:4] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 703 0.0 0.0 0 0 ? SN 17:11 0:00 \_ [kipmi0] 2023-07-29T17:14:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:root 731 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/4:3-events] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 742 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [rpciod] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 743 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xprtiod] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 763 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfsalloc] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 764 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs_mru_cache] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 765 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-buf/dm-4] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 766 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-conv/dm-4] 2023-07-29T17:14:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:root 767 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-cil/dm-4] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 768 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-reclaim/dm-] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 769 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-gc/dm-4] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 770 0.0 0.0 0 0 ? I< 17:11 0:00 \_ [xfs-log/dm-4] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 771 0.0 0.0 0 0 ? S 17:11 0:00 \_ [xfsaild/dm-4] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 2031 0.0 0.0 0 0 ? I 17:11 0:00 \_ [kworker/5:3-events] 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 1 1.1 0.0 241384 14208 ? Ss 17:11 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 18 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 580 0.0 0.0 89564 11928 ? Ss 17:11 0:00 /usr/lib/systemd/systemd-journald 2023-07-29T17:14:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:root 619 0.2 0.0 102056 13728 ? Ss 17:11 0:00 /usr/lib/systemd/systemd-udevd 2023-07-29T17:14:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:rpc 722 0.0 0.0 67248 5456 ? Ss 17:11 0:00 /usr/bin/rpcbind -w -f 2023-07-29T17:14:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:root 736 0.0 0.0 130836 2276 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T17:14:56.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T17:14:56.929 DEBUG:teuthology.orchestra.run.smithi093:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T17:14:56.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T17:14:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T17:14:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T17:14:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T17:14:56.983 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T17:14:56.990 INFO:tasks.ceph:Archiving crash dumps... 2023-07-29T17:14:56.992 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi073/crash 2023-07-29T17:14:56.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T17:14:57.058 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi092/crash 2023-07-29T17:14:57.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T17:14:57.110 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi093/crash 2023-07-29T17:14:57.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T17:14:57.164 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi153/crash 2023-07-29T17:14:57.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T17:14:57.205 INFO:tasks.ceph:Compressing logs... 2023-07-29T17:14:57.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:57.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:57.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:57.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:57.508 INFO:tasks.ceph:Archiving logs... 2023-07-29T17:14:57.509 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi073/log 2023-07-29T17:14:57.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T17:14:57.617 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi092/log 2023-07-29T17:14:57.619 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T17:14:57.657 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi093/log 2023-07-29T17:14:57.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T17:14:57.696 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi153/log 2023-07-29T17:14:57.697 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T17:14:57.737 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1197, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1179, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-1' 2023-07-29T17:14:57.738 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-29T17:14:57.748 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T17:14:57.748 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-29T17:14:57.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T17:14:57.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T17:14:57.754 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T17:14:57.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T17:14:57.904 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-29T17:14:57.914 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-29T17:14:57.914 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:14:57.917 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:14:57.919 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:14:57.921 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T17:14:57.931 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-07-29T17:14:57.933 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-07-29T17:14:57.935 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:14:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-07-29T17:14:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1858us[+1858us] +/- 89ms 2023-07-29T17:14:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -3601us[-3580us] +/- 66ms 2023-07-29T17:14:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +2632us[+2632us] +/- 76ms 2023-07-29T17:14:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:14:57.937 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-07-29T17:14:57.937 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:14:57.938 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-07-29T17:14:57.938 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1849us[+1849us] +/- 89ms 2023-07-29T17:14:57.938 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -3623us[-3574us] +/- 66ms 2023-07-29T17:14:57.938 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +2651us[+2651us] +/- 76ms 2023-07-29T17:14:57.938 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:14:57.939 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-07-29T17:14:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:14:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-07-29T17:14:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv01.front.sepia.ceph.com 2 6 77 57 +1840us[+1911us] +/- 89ms 2023-07-29T17:14:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:^* hv02.front.sepia.ceph.com 3 6 77 56 -3626us[-3555us] +/- 66ms 2023-07-29T17:14:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 56 +2616us[+2687us] +/- 76ms 2023-07-29T17:14:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:14:57.942 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T17:14:57.942 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-07-29T17:14:57.943 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1914us[+1914us] +/- 89ms 2023-07-29T17:14:57.943 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -3543us[-3529us] +/- 66ms 2023-07-29T17:14:57.943 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +2676us[+2676us] +/- 76ms 2023-07-29T17:14:57.943 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T17:14:57.944 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-29T17:14:57.954 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-29T17:14:57.955 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-29T17:14:57.982 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T17:14:58.069 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T17:14:58.153 DEBUG:teuthology.orchestra.run.smithi093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T17:14:58.307 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T17:14:58.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T17:14:58.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:58.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T17:14:58.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:58.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T17:14:58.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:58.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T17:14:58.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:58.526 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-29T17:14:58.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-29T17:14:58.575 INFO:teuthology.task.internal:Duration was 1091.767436 seconds 2023-07-29T17:14:58.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-29T17:14:58.608 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-29T17:14:58.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T17:14:58.611 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T17:14:58.613 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T17:14:58.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T17:14:58.658 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T17:14:58.658 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T17:14:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T17:14:58.715 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T17:14:59.114 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-29T17:14:59.114 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-07-29T17:14:59.115 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T17:14:59.139 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-07-29T17:14:59.140 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T17:14:59.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-07-29T17:14:59.163 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T17:14:59.186 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-07-29T17:14:59.187 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T17:14:59.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-29T17:14:59.211 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:59.214 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:59.216 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:59.229 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T17:14:59.288 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-29T17:14:59.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T17:14:59.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T17:14:59.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T17:14:59.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T17:14:59.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-29T17:14:59.412 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-29T17:14:59.413 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T17:14:59.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T17:14:59.467 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T17:14:59.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T17:14:59.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-29T17:14:59.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.559 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-07-29T17:14:59.561 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-07-29T17:14:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-07-29T17:14:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-07-29T17:14:59.614 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:59.632 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:59.650 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:59.669 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T17:14:59.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:59.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-29T17:14:59.697 INFO:teuthology.task.internal:Transferring archived files... 2023-07-29T17:14:59.698 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi073 2023-07-29T17:14:59.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T17:14:59.734 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi092 2023-07-29T17:14:59.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T17:14:59.770 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi093 2023-07-29T17:14:59.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T17:14:59.804 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901/remote/smithi153 2023-07-29T17:14:59.805 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T17:14:59.839 INFO:teuthology.task.internal:Removing archive directory... 2023-07-29T17:14:59.840 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T17:14:59.842 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T17:14:59.844 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T17:14:59.846 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T17:14:59.893 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-29T17:14:59.909 INFO:teuthology.task.internal:Not uploading archives. 2023-07-29T17:14:59.910 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-29T17:14:59.933 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-29T17:14:59.934 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T17:14:59.936 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T17:14:59.938 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T17:14:59.940 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T17:14:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 29 17:14 /home/ubuntu/cephtest 2023-07-29T17:14:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: 656053 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 17:08 /home/ubuntu/cephtest/ceph.data 2023-07-29T17:14:59.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T17:14:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T17:14:59.953 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-07-29T17:14:59.954 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-29T17:14:59.992 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-29T17:15:00.027 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi073 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T17:15:00.027 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T17:15:00.031 INFO:teuthology.orchestra.run.smithi093.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 29 17:14 /home/ubuntu/cephtest 2023-07-29T17:15:00.031 INFO:teuthology.orchestra.run.smithi093.stdout: 393265 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 17:08 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:15:00.031 INFO:teuthology.orchestra.run.smithi093.stdout: 656052 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 17:08 /home/ubuntu/cephtest/ceph.data 2023-07-29T17:15:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 29 17:14 /home/ubuntu/cephtest 2023-07-29T17:15:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 393265 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 17:08 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:15:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: 656052 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 17:08 /home/ubuntu/cephtest/ceph.data 2023-07-29T17:15:00.032 INFO:teuthology.orchestra.run.smithi092.stdout: 525812 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 29 17:14 /home/ubuntu/cephtest 2023-07-29T17:15:00.033 INFO:teuthology.orchestra.run.smithi092.stdout: 525444 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 17:08 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T17:15:00.033 INFO:teuthology.orchestra.run.smithi092.stdout: 656053 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 17:08 /home/ubuntu/cephtest/ceph.data 2023-07-29T17:15:00.034 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T17:15:00.034 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T17:15:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T17:15:00.063 DEBUG:teuthology.nuke:shortname: smithi073 2023-07-29T17:15:00.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T17:15:00.087 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.074689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2Bjd/ZGQhyoEuwFQwQQmUSQXzEQbGCtKDDAXPgpBQRl45pawflo3FDuk7rbBP/28IWBpFaNlJ1iap8WJwjKs='} 2023-07-29T17:15:00.091 DEBUG:teuthology.nuke:shortname: smithi092 2023-07-29T17:15:00.092 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T17:15:00.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.071864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiwLGs5m8L0bpDn2lsgJZ/+ay7fE4GJIZ++UhZ7gxzJIntha1mlOWWz42UmN7gSs6905UtUSKrI7DD4zYicen9SH7+5WBmnUXN7A/3/D0OQmzDxCJFt7JcvuRPOTvN3YunJi/sXTbhoEEgCfZWQZYzs81ZgNk1CaVfexDjLosEVQd6yiJ6AKdf9j+VIXwA5nGqmcAN2HXdyYVSwx2lZ9gkXMtYehbe87PotzRxwzIS1HjTz8UmYQ/PW9mFDS2NT9vWyGQPf8swTTfgQQOcR6I1dzwgZpkkEKSdQkeL4IFYOYliBkmnj5fF8AfKVYRRi1UO6ALeaH+nnik8aGKpvrtipkMrfIc+t2PzJyBf8d/0xaq4x1YUygGVhyfwrGPTqBuGqvlemDgds+Ix1T/1VzRiLqJ7lrw4zCR61KxHMw+43k/8U53arklMX0wtzDpw6T1tEdj/bPBW6p+HkV4TH4GOVOEI1YR9HGzWab+XWM4kdYU63IYePObQGcXY8V9B1pE='} 2023-07-29T17:15:00.119 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-29T17:15:00.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T17:15:00.137 INFO:teuthology.orchestra.console.smithi073:Power off 2023-07-29T17:15:00.138 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T17:15:00.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.070253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIOkKTrnE+MDnQ3zMC3F8KzYp2EEcmantLIhl3bCESBJZ7W/f3DcEJRftdgI1kyN5vk9JkDtyGoxTOuKcoZITg='} 2023-07-29T17:15:00.153 DEBUG:teuthology.nuke:shortname: smithi153 2023-07-29T17:15:00.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T17:15:00.159 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-07-29T17:15:00.159 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:00.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:42:02.073316', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORe7mcvQFGKGkEap257O5iQXeqpDvrZiIA9ntANn9yDV9mABFmG8Hamo73KBs9/3eSlYNsq4hye9Bs73yVtEsM='} 2023-07-29T17:15:00.189 INFO:teuthology.orchestra.console.smithi092:Power off 2023-07-29T17:15:00.190 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T17:15:00.202 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-07-29T17:15:00.213 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-07-29T17:15:00.214 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:00.233 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-29T17:15:00.234 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T17:15:00.247 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-07-29T17:15:00.256 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-29T17:15:00.256 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:00.277 INFO:teuthology.orchestra.console.smithi153:Power off 2023-07-29T17:15:00.277 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T17:15:00.287 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T17:15:00.308 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-07-29T17:15:00.308 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:00.331 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-07-29T17:15:04.203 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:04.248 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:04.288 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:04.314 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-07-29T17:15:04.333 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:04.360 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-07-29T17:15:04.400 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T17:15:04.444 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-07-29T17:15:08.316 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:08.361 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:08.402 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:08.429 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-07-29T17:15:08.446 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:08.475 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-07-29T17:15:08.513 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T17:15:08.530 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-07-29T17:15:08.556 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-07-29T17:15:08.615 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-29T17:15:08.657 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-07-29T17:15:12.480 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T17:15:12.592 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-07-29T17:15:12.693 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-07-29T17:15:12.797 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} duration: 1091.7674357891083 failure_reason: 'Command failed on smithi073 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json''' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-07-29T17:15:12.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T17:15:12.882 INFO:teuthology.run:FAIL